-- Logs begin at Fri 2022-09-16 18:37:34 UTC, end at Fri 2022-09-16 19:42:28 UTC. -- Sep 16 19:03:48.169921 dv-cinder-803773-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 16 19:03:48.177127 dv-cinder-803773-5-smb devstack@keystone.service[81357]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 19:03:48 2022] *** Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: nodename: dv-cinder-803773-5-smb Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: machine: x86_64 Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: clock source: unix Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: pcre jit disabled Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: detected number of CPU cores: 4 Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: current working directory: / Sep 16 19:03:48.180140 dv-cinder-803773-5-smb devstack@keystone.service[81357]: detected binary path: /usr/bin/uwsgi-core Sep 16 19:03:48.180673 dv-cinder-803773-5-smb devstack@keystone.service[81357]: your processes number limit is 47680 Sep 16 19:03:48.180673 dv-cinder-803773-5-smb devstack@keystone.service[81357]: your memory page size is 4096 bytes Sep 16 19:03:48.180673 dv-cinder-803773-5-smb devstack@keystone.service[81357]: detected max file descriptor number: 2048 Sep 16 19:03:48.180673 dv-cinder-803773-5-smb devstack@keystone.service[81357]: lock engine: pthread robust mutexes Sep 16 19:03:48.180673 dv-cinder-803773-5-smb devstack@keystone.service[81357]: thunder lock: enabled Sep 16 19:03:48.180673 dv-cinder-803773-5-smb devstack@keystone.service[81357]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 16 19:03:48.180673 dv-cinder-803773-5-smb devstack@keystone.service[81357]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 19:03:48.219628 dv-cinder-803773-5-smb devstack@keystone.service[81357]: Python main interpreter initialized at 0x55fde2e209c0 Sep 16 19:03:48.219628 dv-cinder-803773-5-smb devstack@keystone.service[81357]: python threads support enabled Sep 16 19:03:48.219628 dv-cinder-803773-5-smb devstack@keystone.service[81357]: your server socket listen backlog is limited to 100 connections Sep 16 19:03:48.219628 dv-cinder-803773-5-smb devstack@keystone.service[81357]: your mercy for graceful operations on workers is 90 seconds Sep 16 19:03:48.220006 dv-cinder-803773-5-smb devstack@keystone.service[81357]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 19:03:48.220086 dv-cinder-803773-5-smb devstack@keystone.service[81357]: *** Operational MODE: preforking *** Sep 16 19:03:48.220319 dv-cinder-803773-5-smb devstack@keystone.service[81357]: *** uWSGI is running in multiple interpreter mode *** Sep 16 19:03:48.220319 dv-cinder-803773-5-smb devstack@keystone.service[81357]: spawned uWSGI master process (pid: 81357) Sep 16 19:03:48.220532 dv-cinder-803773-5-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 16 19:03:48.221607 dv-cinder-803773-5-smb devstack@keystone.service[81357]: spawned uWSGI worker 1 (pid: 81367, cores: 1) Sep 16 19:03:48.221607 dv-cinder-803773-5-smb devstack@keystone.service[81357]: spawned uWSGI worker 2 (pid: 81368, cores: 1) Sep 16 19:03:48.221607 dv-cinder-803773-5-smb devstack@keystone.service[81357]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 19:03:52.493887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 19:03:52.493887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: from cryptography.utils import int_from_bytes Sep 16 19:03:52.494563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 19:03:52.494563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: from cryptography.utils import int_from_bytes Sep 16 19:03:52.495656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 19:03:52.495656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: from cryptography.utils import int_from_bytes Sep 16 19:03:52.496311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 19:03:52.496311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: from cryptography.utils import int_from_bytes Sep 16 19:03:52.544345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 19:03:52.544535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 19:03:52.544718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] command line args: [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 19:03:52.544991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 19:03:52.545171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ================================================================================ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 19:03:52.545426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] admin_token = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.545668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 19:03:52.545751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] config_dir = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.545854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.545938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 19:03:52.546042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] config_source = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.546133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] command line args: [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 19:03:52.546206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] debug = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.546313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 19:03:52.546396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.546709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ================================================================================ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 19:03:52.546824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] admin_token = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.546921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.546921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.547149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] config_dir = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.547246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.547339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.547444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] config_source = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.547546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.547642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] debug = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.547742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.547843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_config_append = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_dir = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_file = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.548944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_config_append = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_dir = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_file = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.549956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.550890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.551026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.551175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.551253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.551423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.551516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.551682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.551759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.551917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.552155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.552277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.552403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] publish_errors = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.552506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.552626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.552740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.552859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.552978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.553098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.553211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.553374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.553501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.553615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] publish_errors = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.553727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] standard_threads = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.553844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.553974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.554096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.554210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.554322 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.554440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.554440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_journal = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.554665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.554784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_json = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.554897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.555031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_stderr = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.555147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] standard_threads = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.555312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] use_syslog = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.555429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.555549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.555669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.555782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.555894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.556014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.556128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_journal = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.556240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.556353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_json = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.556353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_stderr = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.556577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.556701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] use_syslog = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.556821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.556940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 19:03:52.557060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.557174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.557292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.557413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.557527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.557639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.557757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.558425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.558612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.558749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.558870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.559984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.560096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.560215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.560332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.560443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.560561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.560679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.560792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.560915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.561028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.561138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.561248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.561359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.561475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.561661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.561776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.561893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.562957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.563090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.563202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.563313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.563424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.563545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.563666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.563780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.563898 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564580 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.564920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565613 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.565960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.566956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.567278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.567278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.567496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.567615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.567729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.567729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.567954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.567954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.568171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.568284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.568396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.568396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.568653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.568653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.568877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.568990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.569103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.569224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.569338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.569457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.569576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.569690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.569808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.569808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.570840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.571977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.572092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.572205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.572319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.572440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.572559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.572674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.572795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.572909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.573021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.573141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.573261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.573384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.573499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.574186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.574313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.574434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.574544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.574665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.574778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.574890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.575060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.575177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.575393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.575393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.575632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.575743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.575856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.575969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.576078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.576188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.576302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.576415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.576535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.576650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.576763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.576883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.577929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.578042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.578155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.578276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.578391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.578503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.578652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.578769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.578874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.579068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.579188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.579303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.579417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.579529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.579653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.579783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.579906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.580936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.581983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.582098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.582223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.external = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.582338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.582451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.582567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.582710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.582838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.582962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.583133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.583251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.password = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.583366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.583480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] auth.token = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.583593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.external = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.583716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.583833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.583948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.password = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] auth.token = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.584987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.585109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.585225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.585339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.585453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.585566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.585680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.585805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.585922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.586977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.587107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.587234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.587351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.587465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.587579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.587693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.587807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.587929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.588046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.588160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.588273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.588388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.588501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.588626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.588779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.588894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.589008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.589123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.589237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.589360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.589481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.589631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.589887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.590954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.591114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.591114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.591332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.591446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.591573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.591690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.591805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.591920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.592034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.592148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.592271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.592388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.592503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.592618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.592747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.592862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.593987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.594101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.594224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.594341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.594465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.594581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.594695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.594816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.594932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.595060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.595188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.595306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.595421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.595536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.595650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.595763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.595886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.596927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.597964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.598081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.598194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.598308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.598422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.598537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.598659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.598807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.598923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.599903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.600377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.600377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.600593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.600707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.600821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.600944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.601991 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.602106 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.602220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.602342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.602458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.602458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.602677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.602792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.602907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603165 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.603976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.604090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.604205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.604320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.604320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.604549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.604665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.604817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.605058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.605216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.605341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.605448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.605562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.605676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.605790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.605906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.606958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.607121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.607238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.607352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.607479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.607596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.607711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.607825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.607941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.608055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.608178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.608300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.608416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.608530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.608645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.608760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.608915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.609970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.610085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.610200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.610322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.610438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.610553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.610667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.610782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.610896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.611967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.612081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.612197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.612311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.612434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.612551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.612666 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.612784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.612898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.613950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.614065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.614179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.614295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.614410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.614532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.614649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.614764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.614879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.615039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.615158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.615286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.615403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.615519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.615633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.615747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] role.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.615931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] role.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.616988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.617103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] role.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.617217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.617339 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] role.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.617457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.617572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.617687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.617801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.617915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.618041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.618158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.618272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.618387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.618502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.618617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.618739 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.618855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.619930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.620044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.620199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.620317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.620922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.621972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.622188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.622302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.622416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.622530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.622654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.622774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.622889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.623984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.624107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.624223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.624337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.624452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.624565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.624680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.624803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.624919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.625959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.626073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.626200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.626317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.626431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.626545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.626659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.626773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.626896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.627968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.628090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.628214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.628330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.628452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.628568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.628682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.628796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.628912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.629063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.629190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.629308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.629422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.629536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.629659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.629783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.629900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.630016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.630138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.630255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.630369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.630483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.630604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.630720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.630844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.631247 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.631371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.631486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.631602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.631716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.631844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.631961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.632113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.632230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.632344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.632459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.632582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.632702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.632818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.632952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81368) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 19:03:52.633655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 19:03:52.633655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81367) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 19:03:52.660828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.661061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.661289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.661738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.661977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.662209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.669968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.670594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.698286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.698564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.699410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.699645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.752111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.752568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.800730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.800962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.801504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.801743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.957174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.957343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.957474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.957562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.957691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.957776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.957921 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.958005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.958147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.958239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.958372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.958592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.981633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.981764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.981849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982051 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.982982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.983148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.993935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:52.994425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.006500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.006733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.006844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.006942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.007122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.007205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.007352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.007433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.007577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.007659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.007796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.007876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81368) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.008014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.008231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81367) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 19:03:53.024782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.024991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 19:03:53.025336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.025417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.025537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 19:03:53.025634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 19:03:53.025815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.025895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.026079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.026159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 19:03:53.026340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.026422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.026601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.026745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.026923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.027221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.036256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.036536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.036809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.036890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.037093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.037187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.037379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.037665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.044567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.045348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.047477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.047768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.048054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.048322 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.048403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.048615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.048706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.048879 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.048961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.049152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.049233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.049430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.049511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.049702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.049782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.049975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.050061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.050245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.050324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.050517 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.050795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.051094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.073504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.074632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.075301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.075591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.076135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.076429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.080261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.080549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.080832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.081117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.081410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.081700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.087176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.087469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.088091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.088387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.093179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.093482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.093770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.094056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.094209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.094331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.094514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.094597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.094811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.094891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.095132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.095217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.095421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.095705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.095983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.096260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.111356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.111636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.112653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.112939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.115474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.116944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.118692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.119000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.120220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.121152 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.123804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.125469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.126964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.128709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.130200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.130502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.130789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.131114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.131407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.131704 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.131970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.132278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.132569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.132856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.133137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.133437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.147593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.147882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.148149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.148412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.149302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.149600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.149872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.150141 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.155462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.156990 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.157404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.158505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.158785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.158956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.160520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.160802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.161497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.161785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.162070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.162353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.162749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.163610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.163913 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.164204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.164493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.164886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.174533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.174822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.175132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.175418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.175798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.176079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.176359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.176871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.177164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.177449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.177734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.178120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.178407 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.178701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.191909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.194381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.194801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.197316 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.197717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.199956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.200788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.201424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.201710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.202100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.202302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.203795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.204091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.204509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.208520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.209922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.210880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.212407 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.212820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.213224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.213515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.213793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.215376 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.215781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.216075 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.216359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.221766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.222060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.222343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.224195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.224494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.224786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.229475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81368) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.230262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.230563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.230833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.231135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.231409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.231683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.231971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.232240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.232495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81367) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 19:03:53.232627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.232783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.232872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.233044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.233132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.233323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.233460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.233601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.233680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81368) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.233879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.234161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.234449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.234722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.235029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.235311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.235577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.235854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.236151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81367) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 19:03:53.268509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fde2e209c0 pid: 81368 (default app) Sep 16 19:03:53.270847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fde2e209c0 pid: 81367 (default app) Sep 16 19:03:53.271783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28caf9-6cf6-4a87-91cf-119be03ae0c3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:03:53.272073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28caf9-6cf6-4a87-91cf-119be03ae0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:03:53.272347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28caf9-6cf6-4a87-91cf-119be03ae0c3 None None] PATH_INFO: `/v3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:03:53.276501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Fri Sep 16 19:03:53 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:00.059187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062a16b-0c72-4031-ac95-c2ef71964ff3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:00.059738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062a16b-0c72-4031-ac95-c2ef71964ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:00.059738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062a16b-0c72-4031-ac95-c2ef71964ff3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:00.064032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:00.069458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:00.069958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:00.070058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:00.142142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: INFO dbcounter [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] Registered counter for database keystone Sep 16 19:04:00.160914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG oslo_db.sqlalchemy.engines [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81368) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 19:04:00.167135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writer thread running {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 19:04:00.346735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG passlib.handlers.bcrypt [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81368) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 19:04:00.347073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG passlib.handlers.bcrypt [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81368) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 19:04:00.404887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:00.406495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:00.537114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 19:04:00.838503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062a16b-0c72-4031-ac95-c2ef71964ff3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:00.909750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: INFO dbcounter [None req-f062a16b-0c72-4031-ac95-c2ef71964ff3 None None] Registered counter for database keystone Sep 16 19:04:00.931347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG oslo_db.sqlalchemy.engines [None req-f062a16b-0c72-4031-ac95-c2ef71964ff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81367) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 19:04:00.937672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writer thread running {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 19:04:01.056821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062a16b-0c72-4031-ac95-c2ef71964ff3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:01.061139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b0647-82fa-4623-9b5d-efe69ba2a390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:01.061769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0647-82fa-4623-9b5d-efe69ba2a390 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:01.062050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0647-82fa-4623-9b5d-efe69ba2a390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:01.062324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b0647-82fa-4623-9b5d-efe69ba2a390 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:01.070447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0647-82fa-4623-9b5d-efe69ba2a390 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:01.122364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WARNING keystone.common.rbac_enforcer.enforcer [None req-795b0647-82fa-4623-9b5d-efe69ba2a390 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 19:04:01.122658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b0647-82fa-4623-9b5d-efe69ba2a390 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:01.131959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Sep 16 19:04:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:04:01.138031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:01.155563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835f754-f02e-4ed2-9ecb-cd3e540bb5a5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:01.159977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce0e9c-14a2-40a3-9a69-1ccebbb4f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:01.161113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0e9c-14a2-40a3-9a69-1ccebbb4f28c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:01.161400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0e9c-14a2-40a3-9a69-1ccebbb4f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:01.161682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce0e9c-14a2-40a3-9a69-1ccebbb4f28c admin admin] PATH_INFO: `/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:01.163298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0e9c-14a2-40a3-9a69-1ccebbb4f28c admin admin] RBAC: Authorizing `identity:get_project(project_id=15e72dcb5f5c45fcb95f7b09027953b7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:01.216470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f2ce0e9c-14a2-40a3-9a69-1ccebbb4f28c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 19:04:01.216821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ce0e9c-14a2-40a3-9a69-1ccebbb4f28c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:01.221323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Fri Sep 16 19:04:01 2022] GET /identity/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:03.354224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53069f4-4323-4c51-b366-d84d34923322 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:03.354786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53069f4-4323-4c51-b366-d84d34923322 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:03.354786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53069f4-4323-4c51-b366-d84d34923322 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:03.359397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:03.364813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6cf8-7850-463c-aa80-9eb104637d6d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:03.365220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6cf8-7850-463c-aa80-9eb104637d6d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:03.365374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d6cf8-7850-463c-aa80-9eb104637d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:03.385659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b97d6cf8-7850-463c-aa80-9eb104637d6d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:03.388069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b97d6cf8-7850-463c-aa80-9eb104637d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:03.395737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 19:04:03.669124 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53069f4-4323-4c51-b366-d84d34923322 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:03.680957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53069f4-4323-4c51-b366-d84d34923322 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:03.686019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7391e4-0a58-4d28-ba2d-5f21a8f7b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:03.686606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7391e4-0a58-4d28-ba2d-5f21a8f7b998 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:03.686886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7391e4-0a58-4d28-ba2d-5f21a8f7b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:03.687192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7391e4-0a58-4d28-ba2d-5f21a8f7b998 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:03.694590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7391e4-0a58-4d28-ba2d-5f21a8f7b998 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:03.696382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7391e4-0a58-4d28-ba2d-5f21a8f7b998 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:03.705251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Fri Sep 16 19:04:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:04:03.710691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d6cf8-7850-463c-aa80-9eb104637d6d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:03.719808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d6cf8-7850-463c-aa80-9eb104637d6d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:03.724525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be6f18-e783-4815-808a-99e26aff5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:03.725149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be6f18-e783-4815-808a-99e26aff5d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:03.725692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be6f18-e783-4815-808a-99e26aff5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:03.725975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be6f18-e783-4815-808a-99e26aff5d1d admin admin] PATH_INFO: `/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:03.727376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be6f18-e783-4815-808a-99e26aff5d1d admin admin] RBAC: Authorizing `identity:get_user(user_id=332f1f7a6eb8406bb2e4f9921b706cc7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:03.729201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be6f18-e783-4815-808a-99e26aff5d1d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:03.731267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Fri Sep 16 19:04:03 2022] GET /identity/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:05.934505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab4af-b503-4def-ba5f-6a8ddce16321 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:05.935079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab4af-b503-4def-ba5f-6a8ddce16321 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:05.935079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab4af-b503-4def-ba5f-6a8ddce16321 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:05.936426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:05.941694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b923f-f1d6-4277-b90e-6129a18700cb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:05.942107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b923f-f1d6-4277-b90e-6129a18700cb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:05.942374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b923f-f1d6-4277-b90e-6129a18700cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:05.960214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bc2b923f-f1d6-4277-b90e-6129a18700cb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:05.961388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bc2b923f-f1d6-4277-b90e-6129a18700cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:05.965203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec7cac-9f96-4f9c-97e6-38f55c193791 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:05.965581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec7cac-9f96-4f9c-97e6-38f55c193791 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:05.965930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec7cac-9f96-4f9c-97e6-38f55c193791 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:05.967276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:05.972240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:05.972516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:05.972787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:06.016147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG passlib.handlers.bcrypt [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81367) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 19:04:06.016537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG passlib.handlers.bcrypt [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81367) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 19:04:06.045229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:06.066102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:06.067724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:06.166149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:06.319831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b923f-f1d6-4277-b90e-6129a18700cb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:06.344300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:06.424546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b923f-f1d6-4277-b90e-6129a18700cb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:06.436523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:06.459760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9008c55-9cdd-40a4-a66d-b34fce676e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:06.460407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9008c55-9cdd-40a4-a66d-b34fce676e34 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:06.460694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9008c55-9cdd-40a4-a66d-b34fce676e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:06.460976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9008c55-9cdd-40a4-a66d-b34fce676e34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:06.472736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9008c55-9cdd-40a4-a66d-b34fce676e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d9008c55-9cdd-40a4-a66d-b34fce676e34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:06.481976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:06.483158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:06.483962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:06.488828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9008c55-9cdd-40a4-a66d-b34fce676e34 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:06.540790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379d6f-b0bb-41c4-9c43-d0c51ca596b6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:06.543625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:06.569520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:06.579073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084658-27c3-487c-a882-f4c34b70ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:06.579887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084658-27c3-487c-a882-f4c34b70ba0a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:06.580172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084658-27c3-487c-a882-f4c34b70ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:06.580451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084658-27c3-487c-a882-f4c34b70ba0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:06.587741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9008c55-9cdd-40a4-a66d-b34fce676e34 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:06.621591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:06.622201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:06.622481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:06.622758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:06.623452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:06.623758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:06.625154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:06.637512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:06.643252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:06.647027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc084658-27c3-487c-a882-f4c34b70ba0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:06.648579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc084658-27c3-487c-a882-f4c34b70ba0a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:06.741372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fb0f2-87e5-4bd0-b30e-8a5120fd61e7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:06.745793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:04:06.751440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084658-27c3-487c-a882-f4c34b70ba0a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:06.754402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:06.776536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709124e0-0495-41ed-a8c7-c7927c40b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:06.777904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709124e0-0495-41ed-a8c7-c7927c40b364 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:06.778189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709124e0-0495-41ed-a8c7-c7927c40b364 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:06.778470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709124e0-0495-41ed-a8c7-c7927c40b364 None admin] PATH_INFO: `/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:06.779623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709124e0-0495-41ed-a8c7-c7927c40b364 None admin] RBAC: Authorizing `identity:get_user(user_id=332f1f7a6eb8406bb2e4f9921b706cc7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:06.781077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709124e0-0495-41ed-a8c7-c7927c40b364 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:06.782637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:06 2022] GET /identity/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:06.788015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709124e0-0495-41ed-a8c7-c7927c40b364 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:06.802547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:06.851751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084658-27c3-487c-a882-f4c34b70ba0a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:06.887113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:06.887966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:06.888250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:06.888529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:06.888616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709124e0-0495-41ed-a8c7-c7927c40b364 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:06.906626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:06.908130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:06.922549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8540d-3f03-4973-beaf-59d9580b7b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:06.923200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8540d-3f03-4973-beaf-59d9580b7b9f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:06.923480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8540d-3f03-4973-beaf-59d9580b7b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:06.923751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8540d-3f03-4973-beaf-59d9580b7b9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:06.924843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8540d-3f03-4973-beaf-59d9580b7b9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:04:06.926105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:06.926925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:04:06.927763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:04:06.927763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:04:06.927763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:06.927924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8540d-3f03-4973-beaf-59d9580b7b9f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:06.927998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:04:06.928069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:06.933661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:06.933893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8540d-3f03-4973-beaf-59d9580b7b9f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:06.990741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:07.013766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:07.034174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8540d-3f03-4973-beaf-59d9580b7b9f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:07.037181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf897246-630e-438a-9cde-3ee780b1fb41 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:07.067503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861d8c6-42f6-4f88-950c-a2d304a6cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:07.068108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d8c6-42f6-4f88-950c-a2d304a6cd83 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:07.068433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d8c6-42f6-4f88-950c-a2d304a6cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:07.068674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861d8c6-42f6-4f88-950c-a2d304a6cd83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:07.069392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d8c6-42f6-4f88-950c-a2d304a6cd83 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.domain.id=default, user.id=332f1f7a6eb8406bb2e4f9921b706cc7) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:07.069726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d8c6-42f6-4f88-950c-a2d304a6cd83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:07.069901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6761b-d1a5-42da-b36b-b79b9ee62abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:07.070503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6761b-d1a5-42da-b36b-b79b9ee62abe None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:07.070782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6761b-d1a5-42da-b36b-b79b9ee62abe None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:07.071091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6761b-d1a5-42da-b36b-b79b9ee62abe None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:07.071179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861d8c6-42f6-4f88-950c-a2d304a6cd83 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:07.071735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6761b-d1a5-42da-b36b-b79b9ee62abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:07.072039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6761b-d1a5-42da-b36b-b79b9ee62abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:07.073404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6761b-d1a5-42da-b36b-b79b9ee62abe None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:07.078522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Sep 16 19:04:06 2022] GET /identity/v3/role_assignments?user.id=332f1f7a6eb8406bb2e4f9921b706cc7&scope.domain.id=default&role.id=0f99070a6a88400199520fccd98977b6 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:07.092422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:09.436745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9cd1-282e-4898-9a42-59a8ece1d3cd None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:09.437261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9cd1-282e-4898-9a42-59a8ece1d3cd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:09.437261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9cd1-282e-4898-9a42-59a8ece1d3cd None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:09.438487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:09.443781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e632b2-8644-4822-a6d6-8edee17ef7a2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:09.444210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e632b2-8644-4822-a6d6-8edee17ef7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:09.444327 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e632b2-8644-4822-a6d6-8edee17ef7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:09.470114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-74e632b2-8644-4822-a6d6-8edee17ef7a2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:09.471588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-74e632b2-8644-4822-a6d6-8edee17ef7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:09.565969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:09.828723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90705-8faf-4c14-8bf8-7dfe16ce75b9 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:09.829143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe410c-f024-43e4-9e7c-8cd427a3bd18 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:09.829436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe410c-f024-43e4-9e7c-8cd427a3bd18 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:09.829714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe410c-f024-43e4-9e7c-8cd427a3bd18 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:09.830006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90705-8faf-4c14-8bf8-7dfe16ce75b9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:09.830478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90705-8faf-4c14-8bf8-7dfe16ce75b9 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:09.831100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:09.832203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 13/25] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:09.840615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7babaa-dd01-423b-99a5-1625bc5a42ca None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:09.840902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7babaa-dd01-423b-99a5-1625bc5a42ca None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:09.841190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7babaa-dd01-423b-99a5-1625bc5a42ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:09.842926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41d1d-f6c2-4c69-892a-3bf67bf27620 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:09.843449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41d1d-f6c2-4c69-892a-3bf67bf27620 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:09.843915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41d1d-f6c2-4c69-892a-3bf67bf27620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:09.870086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ee7babaa-dd01-423b-99a5-1625bc5a42ca None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:09.871871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ee7babaa-dd01-423b-99a5-1625bc5a42ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:09.872364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a2e41d1d-f6c2-4c69-892a-3bf67bf27620 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:09.873726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a2e41d1d-f6c2-4c69-892a-3bf67bf27620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:09.947350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:10.005782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:10.006626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7babaa-dd01-423b-99a5-1625bc5a42ca None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:10.055262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 16 19:04:10.166987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7babaa-dd01-423b-99a5-1625bc5a42ca None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:10.215709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c950a3b-b251-42d5-9876-e7efc7a349c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:10.216356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950a3b-b251-42d5-9876-e7efc7a349c6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:10.216635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950a3b-b251-42d5-9876-e7efc7a349c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:10.216905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950a3b-b251-42d5-9876-e7efc7a349c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:10.233918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c950a3b-b251-42d5-9876-e7efc7a349c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-8c950a3b-b251-42d5-9876-e7efc7a349c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:10.240468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:10.241305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:10.242060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:10.247595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41d1d-f6c2-4c69-892a-3bf67bf27620 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:10.341568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:10.371901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41d1d-f6c2-4c69-892a-3bf67bf27620 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:10.411105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c950a3b-b251-42d5-9876-e7efc7a349c6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:10.431582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1977c64-8931-4edd-8049-5bd1bc993e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:10.432123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1977c64-8931-4edd-8049-5bd1bc993e1d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:10.434242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1977c64-8931-4edd-8049-5bd1bc993e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:10.434242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1977c64-8931-4edd-8049-5bd1bc993e1d None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:10.434242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1977c64-8931-4edd-8049-5bd1bc993e1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:10.434242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1977c64-8931-4edd-8049-5bd1bc993e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:10.437501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1977c64-8931-4edd-8049-5bd1bc993e1d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:10.454949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:10.456742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9160-9ebd-457b-b7e9-8c0f913f27ed None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:10.458250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9160-9ebd-457b-b7e9-8c0f913f27ed None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:10.458929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d9160-9ebd-457b-b7e9-8c0f913f27ed None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:10.461896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:10.464588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d9160-9ebd-457b-b7e9-8c0f913f27ed None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:10.492045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:10.582216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d9160-9ebd-457b-b7e9-8c0f913f27ed None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:10.596353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c950a3b-b251-42d5-9876-e7efc7a349c6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:10.622777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37506973-5ed0-4f88-98d3-f65a7cf1764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:10.623764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37506973-5ed0-4f88-98d3-f65a7cf1764b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:10.624245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37506973-5ed0-4f88-98d3-f65a7cf1764b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:10.624719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37506973-5ed0-4f88-98d3-f65a7cf1764b None admin] PATH_INFO: `/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:10.626150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37506973-5ed0-4f88-98d3-f65a7cf1764b None admin] RBAC: Authorizing `identity:get_user(user_id=332f1f7a6eb8406bb2e4f9921b706cc7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:10.627842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37506973-5ed0-4f88-98d3-f65a7cf1764b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:10.630062 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 17/31] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:10 2022] GET /identity/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:10.631517 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff3a60-0f19-47b6-a56a-66635f9c2b8f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:10.632050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff3a60-0f19-47b6-a56a-66635f9c2b8f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:10.632539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff3a60-0f19-47b6-a56a-66635f9c2b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:10.634648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:10.635333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:10.635619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:10.635896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:10.641427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:10.647353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:10.648836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:10.656165 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-68ff3a60-0f19-47b6-a56a-66635f9c2b8f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:10.657619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-68ff3a60-0f19-47b6-a56a-66635f9c2b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:04:10.667121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:10.668034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:04:10.668840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:04:10.668840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:04:10.668840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:10.668840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 15/32] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:04:10.669451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:10.740283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 18/33] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:10.741465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff3a60-0f19-47b6-a56a-66635f9c2b8f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:10.787331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:10.817498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f1719-2512-4534-8c03-b2343cb81dda None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:10.873352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe7ce2-24c3-4752-9622-69b9105a0f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:10.874232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe7ce2-24c3-4752-9622-69b9105a0f5f None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:10.874652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe7ce2-24c3-4752-9622-69b9105a0f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:10.875092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe7ce2-24c3-4752-9622-69b9105a0f5f None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:10.875914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe7ce2-24c3-4752-9622-69b9105a0f5f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:10.877643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe7ce2-24c3-4752-9622-69b9105a0f5f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:10.927463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff3a60-0f19-47b6-a56a-66635f9c2b8f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:10.999807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958944bb-8eea-41cd-9721-0eb2d33f2f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:11.000492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958944bb-8eea-41cd-9721-0eb2d33f2f30 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.000850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958944bb-8eea-41cd-9721-0eb2d33f2f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.001205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958944bb-8eea-41cd-9721-0eb2d33f2f30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.002484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958944bb-8eea-41cd-9721-0eb2d33f2f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:11.004071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958944bb-8eea-41cd-9721-0eb2d33f2f30 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:11.005905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 19/34] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:11.006547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958944bb-8eea-41cd-9721-0eb2d33f2f30 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:11.011794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:11.052368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 16/35] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 19:04:10 2022] POST /identity/v3/roles => generated 219 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:11.058840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe7ce2-24c3-4752-9622-69b9105a0f5f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:11.168297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958944bb-8eea-41cd-9721-0eb2d33f2f30 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:11.226523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:11.227183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.227474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.227751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.228423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:11.228731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:11.230405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:11.265784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe7ce2-24c3-4752-9622-69b9105a0f5f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:11.285382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 20/36] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:11.286254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:11.321170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517eef-5c70-4d25-afc1-edc9d1766a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:11.321872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517eef-5c70-4d25-afc1-edc9d1766a56 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.322162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517eef-5c70-4d25-afc1-edc9d1766a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.322449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517eef-5c70-4d25-afc1-edc9d1766a56 None admin] PATH_INFO: `/v3/domains/default/users/332f1f7a6eb8406bb2e4f9921b706cc7/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.325275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517eef-5c70-4d25-afc1-edc9d1766a56 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=332f1f7a6eb8406bb2e4f9921b706cc7, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:11.327411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517eef-5c70-4d25-afc1-edc9d1766a56 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:11.351032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 17/37] 10.222.0.20 () {58 vars in 1361 bytes} [Fri Sep 16 19:04:11 2022] PUT /identity/v3/domains/default/users/332f1f7a6eb8406bb2e4f9921b706cc7/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:11.351032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517eef-5c70-4d25-afc1-edc9d1766a56 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:11.369383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:11.374329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:11.442865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ed228-154c-4c3b-958a-b7327eab76c1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:11.486506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07690f1a-ee9b-47ab-815f-53df9a64fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:11.487179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690f1a-ee9b-47ab-815f-53df9a64fca8 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.487508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690f1a-ee9b-47ab-815f-53df9a64fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.487797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07690f1a-ee9b-47ab-815f-53df9a64fca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.488605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07690f1a-ee9b-47ab-815f-53df9a64fca8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:11.490130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07690f1a-ee9b-47ab-815f-53df9a64fca8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:11.509524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517eef-5c70-4d25-afc1-edc9d1766a56 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:11.557775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718073-2f5d-4185-b71a-6923f385896b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:11.557775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718073-2f5d-4185-b71a-6923f385896b None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.558756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718073-2f5d-4185-b71a-6923f385896b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.558756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718073-2f5d-4185-b71a-6923f385896b None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.559536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1718073-2f5d-4185-b71a-6923f385896b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:11.561410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1718073-2f5d-4185-b71a-6923f385896b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:11.599164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 18/38] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:04:11 2022] POST /identity/v3/projects => generated 301 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:11.602682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095ec4-3e05-4012-930f-cf688160602d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.602682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095ec4-3e05-4012-930f-cf688160602d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.602682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2095ec4-3e05-4012-930f-cf688160602d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.603223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 19/39] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:11.604379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e66d1-d87b-430a-91cc-b79ceb8504cd None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.604673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e66d1-d87b-430a-91cc-b79ceb8504cd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.605047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e66d1-d87b-430a-91cc-b79ceb8504cd None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.606646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 20/40] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:11.616896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466438-4cff-4d6a-b581-b9f952c9c1b3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.617236 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466438-4cff-4d6a-b581-b9f952c9c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.617529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26466438-4cff-4d6a-b581-b9f952c9c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.633796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 21/41] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 19:04:11 2022] POST /identity/v3/roles => generated 225 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:11.635377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c82f9-d20a-44bc-9eb4-0ec012af5ffa None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:11.635625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c82f9-d20a-44bc-9eb4-0ec012af5ffa None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:11.635898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c82f9-d20a-44bc-9eb4-0ec012af5ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:11.639610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-26466438-4cff-4d6a-b581-b9f952c9c1b3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:11.641421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-26466438-4cff-4d6a-b581-b9f952c9c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:11.657597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7f5c82f9-d20a-44bc-9eb4-0ec012af5ffa None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:11.659548 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7f5c82f9-d20a-44bc-9eb4-0ec012af5ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:11.716375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:11.732119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 21/42] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:11.813679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 22/43] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:12.046414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26466438-4cff-4d6a-b581-b9f952c9c1b3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:12.100968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c82f9-d20a-44bc-9eb4-0ec012af5ffa None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:12.153208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26466438-4cff-4d6a-b581-b9f952c9c1b3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:12.166986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:12.191199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf469f7b-3eb3-4ef9-a1ab-ffc3e7ab5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:12.192091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf469f7b-3eb3-4ef9-a1ab-ffc3e7ab5516 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:12.192371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf469f7b-3eb3-4ef9-a1ab-ffc3e7ab5516 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:12.192696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf469f7b-3eb3-4ef9-a1ab-ffc3e7ab5516 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:12.193831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf469f7b-3eb3-4ef9-a1ab-ffc3e7ab5516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:12.195304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf469f7b-3eb3-4ef9-a1ab-ffc3e7ab5516 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:12.199470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 22/44] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:12.202615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf469f7b-3eb3-4ef9-a1ab-ffc3e7ab5516 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:12.225873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c82f9-d20a-44bc-9eb4-0ec012af5ffa None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:12.268837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:12.318812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf469f7b-3eb3-4ef9-a1ab-ffc3e7ab5516 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:12.357639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16153a74-70c3-4b7c-8ac4-b1f873af8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:12.358166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16153a74-70c3-4b7c-8ac4-b1f873af8293 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:12.358446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16153a74-70c3-4b7c-8ac4-b1f873af8293 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:12.358719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16153a74-70c3-4b7c-8ac4-b1f873af8293 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:12.359413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16153a74-70c3-4b7c-8ac4-b1f873af8293 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:12.360857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16153a74-70c3-4b7c-8ac4-b1f873af8293 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:12.371860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c38532-07ac-4fd6-af00-8b6d3d7f0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:12.372474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38532-07ac-4fd6-af00-8b6d3d7f0958 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:12.372758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38532-07ac-4fd6-af00-8b6d3d7f0958 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:12.373037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38532-07ac-4fd6-af00-8b6d3d7f0958 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:12.373712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c38532-07ac-4fd6-af00-8b6d3d7f0958 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:12.375234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c38532-07ac-4fd6-af00-8b6d3d7f0958 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:12.388773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:04:12 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:04:12.390369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 19:04:12 2022] POST /identity/v3/roles => generated 223 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:04:13.580409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5d252-17ab-4208-9290-850f8a40ba25 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:13.580950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5d252-17ab-4208-9290-850f8a40ba25 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:13.580950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5d252-17ab-4208-9290-850f8a40ba25 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:13.582330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:13.587751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3b77-0c0d-4418-84ac-5ba8fece938d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:13.588142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3b77-0c0d-4418-84ac-5ba8fece938d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:13.588426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3b77-0c0d-4418-84ac-5ba8fece938d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:13.606655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-566a3b77-0c0d-4418-84ac-5ba8fece938d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:13.607858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-566a3b77-0c0d-4418-84ac-5ba8fece938d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:13.675425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:13.939127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5d252-17ab-4208-9290-850f8a40ba25 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:14.040838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5d252-17ab-4208-9290-850f8a40ba25 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:14.052208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:14.076865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fad40-7bf4-45bf-a080-6fe04c5bdc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:14.077492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fad40-7bf4-45bf-a080-6fe04c5bdc4d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:14.077773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fad40-7bf4-45bf-a080-6fe04c5bdc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:14.078050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fad40-7bf4-45bf-a080-6fe04c5bdc4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:14.088255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72fad40-7bf4-45bf-a080-6fe04c5bdc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f72fad40-7bf4-45bf-a080-6fe04c5bdc4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:14.094009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:14.095014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:14.095790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 25/49] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:14.101411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a3b77-0c0d-4418-84ac-5ba8fece938d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:14.143770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:14.201463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a3b77-0c0d-4418-84ac-5ba8fece938d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:14.235506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:14.236118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:14.236402 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:14.236683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:14.237351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:14.237662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:14.239092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:14.247391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 25/50] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:14.253194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fad40-7bf4-45bf-a080-6fe04c5bdc4d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:14.354932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72fad40-7bf4-45bf-a080-6fe04c5bdc4d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:14.392818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fccc8a-c429-4dc4-892d-314f72fd8ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:14.393454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fccc8a-c429-4dc4-892d-314f72fd8ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:14.393730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fccc8a-c429-4dc4-892d-314f72fd8ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:14.394003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fccc8a-c429-4dc4-892d-314f72fd8ce7 None admin] PATH_INFO: `/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:14.395143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fccc8a-c429-4dc4-892d-314f72fd8ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=332f1f7a6eb8406bb2e4f9921b706cc7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:14.396969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fccc8a-c429-4dc4-892d-314f72fd8ce7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:14.403694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:14 2022] GET /identity/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:14.404884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:14.511595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1d629-8a49-4702-9726-e4d0cd2318bb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:14.514220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:14.546809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c184bc3-bba5-422d-b320-84f969496031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:14.547497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184bc3-bba5-422d-b320-84f969496031 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:14.547779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184bc3-bba5-422d-b320-84f969496031 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:14.548053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c184bc3-bba5-422d-b320-84f969496031 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:14.549161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c184bc3-bba5-422d-b320-84f969496031 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:14.550607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c184bc3-bba5-422d-b320-84f969496031 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:14.552208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 26/52] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:14.558520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fccc8a-c429-4dc4-892d-314f72fd8ce7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:14.581580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4883a-d7af-4c29-8cc0-4f45f0d523b9 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:14.581866 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4883a-d7af-4c29-8cc0-4f45f0d523b9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:14.582148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4883a-d7af-4c29-8cc0-4f45f0d523b9 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:14.583724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 27/53] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:14.589401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee5c2b-d924-442b-bce0-aa419d4b3ed2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:14.590059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee5c2b-d924-442b-bce0-aa419d4b3ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:14.590059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee5c2b-d924-442b-bce0-aa419d4b3ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:14.609440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-98ee5c2b-d924-442b-bce0-aa419d4b3ed2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:14.610701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-98ee5c2b-d924-442b-bce0-aa419d4b3ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:14.684034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 28/54] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:14.705723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:14.767420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fccc8a-c429-4dc4-892d-314f72fd8ce7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:14.801182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:14.801792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:14.802081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:14.802365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:14.803142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.domain.id=default, user.id=332f1f7a6eb8406bb2e4f9921b706cc7) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:14.803466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:14.804910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:14.812890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1322 bytes} [Fri Sep 16 19:04:14 2022] GET /identity/v3/role_assignments?user.id=332f1f7a6eb8406bb2e4f9921b706cc7&scope.domain.id=default&role.id=0f99070a6a88400199520fccd98977b6 => generated 530 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:14.957379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee5c2b-d924-442b-bce0-aa419d4b3ed2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:15.060585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee5c2b-d924-442b-bce0-aa419d4b3ed2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:15.062027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:15.095106 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35e8a2-47ba-4bef-ab62-c1c9315eae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:15.095735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e8a2-47ba-4bef-ab62-c1c9315eae13 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:15.096017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e8a2-47ba-4bef-ab62-c1c9315eae13 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:15.096290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35e8a2-47ba-4bef-ab62-c1c9315eae13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:15.097368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e8a2-47ba-4bef-ab62-c1c9315eae13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:15.098818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35e8a2-47ba-4bef-ab62-c1c9315eae13 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:15.100411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 29/56] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:15.106937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:15.204176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b8159-ad98-4639-a665-04b3d05bcaf6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:15.205649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:15.238749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbad972-d6da-4206-a74d-0ed767bcc35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:15.239390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad972-d6da-4206-a74d-0ed767bcc35c None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:15.239676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad972-d6da-4206-a74d-0ed767bcc35c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:15.239959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbad972-d6da-4206-a74d-0ed767bcc35c None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:15.240618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbad972-d6da-4206-a74d-0ed767bcc35c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:15.242057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbad972-d6da-4206-a74d-0ed767bcc35c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:15.267735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 28/57] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Sep 16 19:04:15 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:04:17.395534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab9be4-cb9a-45f3-b03a-66b980c7524e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:17.396055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab9be4-cb9a-45f3-b03a-66b980c7524e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:17.396140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab9be4-cb9a-45f3-b03a-66b980c7524e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:17.397506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 30/58] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:17.402977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25418e22-8f74-4e5b-9930-96cebc63437c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:17.403432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25418e22-8f74-4e5b-9930-96cebc63437c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:17.403561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25418e22-8f74-4e5b-9930-96cebc63437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:17.423001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-25418e22-8f74-4e5b-9930-96cebc63437c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:17.425019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-25418e22-8f74-4e5b-9930-96cebc63437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:17.492385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 29/59] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:17.762768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab9be4-cb9a-45f3-b03a-66b980c7524e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:17.862084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab9be4-cb9a-45f3-b03a-66b980c7524e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:17.895605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c854f5a-b9ee-43f0-85d8-0ad259c94a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:17.896229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c854f5a-b9ee-43f0-85d8-0ad259c94a24 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:17.896516 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c854f5a-b9ee-43f0-85d8-0ad259c94a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:17.896794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c854f5a-b9ee-43f0-85d8-0ad259c94a24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:17.897904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c854f5a-b9ee-43f0-85d8-0ad259c94a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:17.899378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c854f5a-b9ee-43f0-85d8-0ad259c94a24 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:17.900927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 31/60] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:17.906917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25418e22-8f74-4e5b-9930-96cebc63437c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:17.988251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:18.004125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25418e22-8f74-4e5b-9930-96cebc63437c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:18.036748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e051541-c767-4d8d-807f-69f893c39719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:18.037294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051541-c767-4d8d-807f-69f893c39719 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:18.037574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051541-c767-4d8d-807f-69f893c39719 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:18.037850 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e051541-c767-4d8d-807f-69f893c39719 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:18.038489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e051541-c767-4d8d-807f-69f893c39719 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:18.039987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e051541-c767-4d8d-807f-69f893c39719 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:18.065927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 30/61] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:04:17 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:21.437034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597738-d701-4543-96ca-3883dddabbf5 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:21.437034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597738-d701-4543-96ca-3883dddabbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:21.437034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597738-d701-4543-96ca-3883dddabbf5 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:21.437705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 32/62] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:21.456864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ca41-be49-4b19-a533-61c3a7a9f9c5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:21.457697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ca41-be49-4b19-a533-61c3a7a9f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:21.458126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ca41-be49-4b19-a533-61c3a7a9f9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:21.480938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-66d9ca41-be49-4b19-a533-61c3a7a9f9c5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:21.482411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-66d9ca41-be49-4b19-a533-61c3a7a9f9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:21.535750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d9fff-c28f-4c4b-aa18-f93fe08c7178 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:21.536039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d9fff-c28f-4c4b-aa18-f93fe08c7178 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:21.536325 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d9fff-c28f-4c4b-aa18-f93fe08c7178 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:21.537932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 33/63] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:21.543852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a74d2-0d91-4edb-b6f1-2112f77c769e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:21.544150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a74d2-0d91-4edb-b6f1-2112f77c769e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:21.544424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a74d2-0d91-4edb-b6f1-2112f77c769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:21.566024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-821a74d2-0d91-4edb-b6f1-2112f77c769e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:21.568283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-821a74d2-0d91-4edb-b6f1-2112f77c769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:21.591666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 31/64] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:21.594763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63f547-c6eb-4f37-bcb3-2e0fbb0b79a9 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:21.595196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63f547-c6eb-4f37-bcb3-2e0fbb0b79a9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:21.595476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63f547-c6eb-4f37-bcb3-2e0fbb0b79a9 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:21.597375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 32/65] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:21.604462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ab11-0b08-4a91-9646-0129245758bc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:21.605265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ab11-0b08-4a91-9646-0129245758bc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:21.605680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ab11-0b08-4a91-9646-0129245758bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:21.619577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:21.639023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8ad8ab11-0b08-4a91-9646-0129245758bc None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:21.640428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8ad8ab11-0b08-4a91-9646-0129245758bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:21.667664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 34/66] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:21.741218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:21.751960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 33/67] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:21.950518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a74d2-0d91-4edb-b6f1-2112f77c769e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.021933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434666-a5ea-4edb-9a91-b8c17bb4bbd8 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.021933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434666-a5ea-4edb-9a91-b8c17bb4bbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.022293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434666-a5ea-4edb-9a91-b8c17bb4bbd8 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.023829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 34/68] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:22.029942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c9d4-f076-40db-89d8-5bf4fa14c232 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.030241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c9d4-f076-40db-89d8-5bf4fa14c232 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.030527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c9d4-f076-40db-89d8-5bf4fa14c232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.049024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a652c9d4-f076-40db-89d8-5bf4fa14c232 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:22.050210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a652c9d4-f076-40db-89d8-5bf4fa14c232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:22.079128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a74d2-0d91-4edb-b6f1-2112f77c769e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.115654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91514281-a4e6-499c-b908-61f089506b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.116890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514281-a4e6-499c-b908-61f089506b92 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.116890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514281-a4e6-499c-b908-61f089506b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.117066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514281-a4e6-499c-b908-61f089506b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.127806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91514281-a4e6-499c-b908-61f089506b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-91514281-a4e6-499c-b908-61f089506b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:22.132639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:22.133451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:22.135682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:22.137086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 35/69] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:22.137228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:22.137356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c9d4-f076-40db-89d8-5bf4fa14c232 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.137437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911c080-2101-4d5b-8fc5-d9ac0ba9b9a7 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.137437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911c080-2101-4d5b-8fc5-d9ac0ba9b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.137437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911c080-2101-4d5b-8fc5-d9ac0ba9b9a7 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.138364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 36/71] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:22.139201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911c080-2101-4d5b-8fc5-d9ac0ba9b9a7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.171318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:22.243502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911c080-2101-4d5b-8fc5-d9ac0ba9b9a7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.248498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c9d4-f076-40db-89d8-5bf4fa14c232 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.278400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6e70a-1a7b-4599-b082-3ae599574afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.278956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e70a-1a7b-4599-b082-3ae599574afe None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.279271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e70a-1a7b-4599-b082-3ae599574afe None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.279544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6e70a-1a7b-4599-b082-3ae599574afe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.281372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:22.288613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc12db9-b04c-4c89-ae15-04f82ff350e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.289477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12db9-b04c-4c89-ae15-04f82ff350e7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.289951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12db9-b04c-4c89-ae15-04f82ff350e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.290196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6e70a-1a7b-4599-b082-3ae599574afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:22.290580 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc12db9-b04c-4c89-ae15-04f82ff350e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-9cf6e70a-1a7b-4599-b082-3ae599574afe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:22.295058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:22.295899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:22.296642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 37/72] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:22.297746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6e70a-1a7b-4599-b082-3ae599574afe None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.307211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc12db9-b04c-4c89-ae15-04f82ff350e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-dcc12db9-b04c-4c89-ae15-04f82ff350e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:22.312891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:22.313808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:22.314723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:22.316634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:22.318430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773da03c-039c-4be5-84e4-ac2565241ca1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.318722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773da03c-039c-4be5-84e4-ac2565241ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.319022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773da03c-039c-4be5-84e4-ac2565241ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.337825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-773da03c-039c-4be5-84e4-ac2565241ca1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:22.339597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-773da03c-039c-4be5-84e4-ac2565241ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:22.392151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:22.405305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6e70a-1a7b-4599-b082-3ae599574afe None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.412244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 37/74] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:22.413765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773da03c-039c-4be5-84e4-ac2565241ca1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.441681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.442292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.442821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.443137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.443806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:22.444113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:22.445493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:22.454959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 38/75] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:22.460400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.532196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773da03c-039c-4be5-84e4-ac2565241ca1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.555182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:22.568521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58886c78-440f-4c15-840c-2d6c9407dec8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.574019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.574684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.574975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.575337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.576540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:22.576857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:22.578734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:22.594041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 38/76] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:22.594953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.603213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.603827 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.604110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.604388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.605629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:22.605938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:22.607368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:22.618657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:22.618657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.636588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:22.708221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aee44f-5279-44fb-8ca6-f0a60d9f20f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.725510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ead5-e2a6-4851-9cbb-81d3f5d7b8a7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.742206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5ef7b-4ab0-4123-8297-669dc79023e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.742838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ef7b-4ab0-4123-8297-669dc79023e3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.743156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ef7b-4ab0-4123-8297-669dc79023e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.743435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ef7b-4ab0-4123-8297-669dc79023e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.744556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5ef7b-4ab0-4123-8297-669dc79023e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:22.746563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5ef7b-4ab0-4123-8297-669dc79023e3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:22.751109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:22.751109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5ef7b-4ab0-4123-8297-669dc79023e3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.763015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ae675-ae4c-4cbe-ac25-44cef6779e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.763789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ae675-ae4c-4cbe-ac25-44cef6779e9b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.764018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ae675-ae4c-4cbe-ac25-44cef6779e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.764297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ae675-ae4c-4cbe-ac25-44cef6779e9b None admin] PATH_INFO: `/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.765440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ae675-ae4c-4cbe-ac25-44cef6779e9b None admin] RBAC: Authorizing `identity:get_user(user_id=332f1f7a6eb8406bb2e4f9921b706cc7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:22.766901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ae675-ae4c-4cbe-ac25-44cef6779e9b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:22.768515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:22.769271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ae675-ae4c-4cbe-ac25-44cef6779e9b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.804383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:22.848212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:22.855775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5ef7b-4ab0-4123-8297-669dc79023e3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.867869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ae675-ae4c-4cbe-ac25-44cef6779e9b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:22.891390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365eb8a-17c0-4859-837e-09681133b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.892028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365eb8a-17c0-4859-837e-09681133b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.892310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365eb8a-17c0-4859-837e-09681133b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.892589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365eb8a-17c0-4859-837e-09681133b3d8 None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.902015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c8b8-5056-421c-bd4f-6a456bbf20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:22.902644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c8b8-5056-421c-bd4f-6a456bbf20bb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:22.902931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c8b8-5056-421c-bd4f-6a456bbf20bb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:22.903244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c8b8-5056-421c-bd4f-6a456bbf20bb None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:22.907645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365eb8a-17c0-4859-837e-09681133b3d8 None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:22.909095 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365eb8a-17c0-4859-837e-09681133b3d8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:22.910721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:22.911524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365eb8a-17c0-4859-837e-09681133b3d8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:22.918401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7c8b8-5056-421c-bd4f-6a456bbf20bb None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:22.919893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7c8b8-5056-421c-bd4f-6a456bbf20bb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:22.921679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:22.922364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c8b8-5056-421c-bd4f-6a456bbf20bb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:23.013057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365eb8a-17c0-4859-837e-09681133b3d8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.019602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c8b8-5056-421c-bd4f-6a456bbf20bb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.022014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:23.048007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fdd1c-7360-41c4-8a98-f83ffeeb5ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:23.048668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fdd1c-7360-41c4-8a98-f83ffeeb5ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:23.048955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fdd1c-7360-41c4-8a98-f83ffeeb5ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:23.049233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fdd1c-7360-41c4-8a98-f83ffeeb5ea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:23.053596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0c80c-6479-4987-bdb4-aad6946da7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:23.054194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c80c-6479-4987-bdb4-aad6946da7d4 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:23.054524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c80c-6479-4987-bdb4-aad6946da7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:23.054756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0c80c-6479-4987-bdb4-aad6946da7d4 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:23.055433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0c80c-6479-4987-bdb4-aad6946da7d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:23.056871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0c80c-6479-4987-bdb4-aad6946da7d4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:23.059656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fdd1c-7360-41c4-8a98-f83ffeeb5ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-313fdd1c-7360-41c4-8a98-f83ffeeb5ea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:23.064558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:23.065348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:23.066098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:23.067236 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fdd1c-7360-41c4-8a98-f83ffeeb5ea0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:23.072110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:23.099021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 42/83] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:04:22 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:23.099021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0c80c-6479-4987-bdb4-aad6946da7d4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:23.200258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fdd1c-7360-41c4-8a98-f83ffeeb5ea0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.200739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0c80c-6479-4987-bdb4-aad6946da7d4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.237708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2da34-a73a-488e-9ed8-186ad8800e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:23.237957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda607c5-44cc-46f8-b7cc-f4945f685cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:23.238348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2da34-a73a-488e-9ed8-186ad8800e61 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:23.238452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda607c5-44cc-46f8-b7cc-f4945f685cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:23.238633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2da34-a73a-488e-9ed8-186ad8800e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:23.238730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda607c5-44cc-46f8-b7cc-f4945f685cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:23.238917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2da34-a73a-488e-9ed8-186ad8800e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:23.239042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda607c5-44cc-46f8-b7cc-f4945f685cb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:23.277658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:23.315870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:23.323123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda607c5-44cc-46f8-b7cc-f4945f685cb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:23.325062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda607c5-44cc-46f8-b7cc-f4945f685cb6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:23.326354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2da34-a73a-488e-9ed8-186ad8800e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:23.327880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2da34-a73a-488e-9ed8-186ad8800e61 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:23.463859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:23.467493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda607c5-44cc-46f8-b7cc-f4945f685cb6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:23.469839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 43/85] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:23.470754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2da34-a73a-488e-9ed8-186ad8800e61 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:23.540828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:23.574809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:23.583146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2da34-a73a-488e-9ed8-186ad8800e61 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.587304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda607c5-44cc-46f8-b7cc-f4945f685cb6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.622247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:23.623255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:23.623540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:23.623817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:23.624487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:23.624795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:23.626314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db54f7-ba8a-4f94-8b5d-36422b745818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:23.626437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:23.626931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db54f7-ba8a-4f94-8b5d-36422b745818 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:23.627243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db54f7-ba8a-4f94-8b5d-36422b745818 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:23.627523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db54f7-ba8a-4f94-8b5d-36422b745818 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:23.636579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 44/86] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:23.637283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:23.708339 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db54f7-ba8a-4f94-8b5d-36422b745818 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:23.709919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db54f7-ba8a-4f94-8b5d-36422b745818 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:23.766293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8756c-4d2b-4d7f-88c3-37a23c090f8e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.795918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:23.811891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4b4a2-20ff-4991-9c23-347b93af5eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:23.812785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b4a2-20ff-4991-9c23-347b93af5eed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:23.813078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b4a2-20ff-4991-9c23-347b93af5eed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:23.813383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4b4a2-20ff-4991-9c23-347b93af5eed None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:23.815272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4b4a2-20ff-4991-9c23-347b93af5eed None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:23.817349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4b4a2-20ff-4991-9c23-347b93af5eed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:23.819063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 45/87] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:23 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:23.820353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4b4a2-20ff-4991-9c23-347b93af5eed None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:23.834439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 43/88] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:23.835259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db54f7-ba8a-4f94-8b5d-36422b745818 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:23.853665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:23.949908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db54f7-ba8a-4f94-8b5d-36422b745818 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.963431 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4b4a2-20ff-4991-9c23-347b93af5eed None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:23.986869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6999c-a01f-4ad1-a2ea-9b23598ecabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:23.987538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6999c-a01f-4ad1-a2ea-9b23598ecabb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:23.987825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6999c-a01f-4ad1-a2ea-9b23598ecabb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:23.988105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6999c-a01f-4ad1-a2ea-9b23598ecabb None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:23.989254 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6999c-a01f-4ad1-a2ea-9b23598ecabb None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:23.990764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6999c-a01f-4ad1-a2ea-9b23598ecabb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:23.992724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 44/89] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:23 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:23.997826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6999c-a01f-4ad1-a2ea-9b23598ecabb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:24.010631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09424861-72c9-4830-bfe8-978e6d4adbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:24.013028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09424861-72c9-4830-bfe8-978e6d4adbba None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:24.013526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09424861-72c9-4830-bfe8-978e6d4adbba None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:24.013997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09424861-72c9-4830-bfe8-978e6d4adbba None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:24.016059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09424861-72c9-4830-bfe8-978e6d4adbba None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:24.018223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09424861-72c9-4830-bfe8-978e6d4adbba None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:24.020565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:23 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:24.021570 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09424861-72c9-4830-bfe8-978e6d4adbba None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:24.038396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:24.118371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6999c-a01f-4ad1-a2ea-9b23598ecabb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:24.140924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:24.151136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09424861-72c9-4830-bfe8-978e6d4adbba None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:24.168722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:24.169772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:24.170514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:24.170986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:24.171945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=8364b69580ec486c8b430bf6e13ce028, user.id=332f1f7a6eb8406bb2e4f9921b706cc7) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:24.172467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:24.174835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:24.182294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:23 2022] GET /identity/v3/role_assignments?user.id=332f1f7a6eb8406bb2e4f9921b706cc7&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=0f99070a6a88400199520fccd98977b6 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:24.184238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:24.189480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08edde-f134-4173-bb72-9f4d6e3eead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:24.189480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08edde-f134-4173-bb72-9f4d6e3eead3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:24.189742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08edde-f134-4173-bb72-9f4d6e3eead3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:24.189962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08edde-f134-4173-bb72-9f4d6e3eead3 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:24.191164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08edde-f134-4173-bb72-9f4d6e3eead3 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:24.192913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08edde-f134-4173-bb72-9f4d6e3eead3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:24.195131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:24 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:24.196314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08edde-f134-4173-bb72-9f4d6e3eead3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:24.378175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08edde-f134-4173-bb72-9f4d6e3eead3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:24.403959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:24.407909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525da4c-869e-45de-9b86-85273a54dcec None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:24.447694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d18a65-9bcf-4059-a79f-d96d2ba52b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:24.448914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d18a65-9bcf-4059-a79f-d96d2ba52b16 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:24.449369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d18a65-9bcf-4059-a79f-d96d2ba52b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:24.449805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d18a65-9bcf-4059-a79f-d96d2ba52b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:24.451906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:24.452550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:24.452841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:24.453124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:24.453870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] RBAC: Adding query filter params (role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=8364b69580ec486c8b430bf6e13ce028, user.id=2340bd445eaf442b8b01340293637271) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:24.454186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:24.455683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:24.468745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 48/93] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:24 2022] GET /identity/v3/role_assignments?user.id=2340bd445eaf442b8b01340293637271&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=377207058e944d2a91e7afd0f3c46025 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:24.469588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:24.528003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:24.543920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d18a65-9bcf-4059-a79f-d96d2ba52b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:24.549029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d18a65-9bcf-4059-a79f-d96d2ba52b16 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:24.682975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:24.692048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 46/94] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:24.694175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d18a65-9bcf-4059-a79f-d96d2ba52b16 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:24.753421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd66560-6792-445e-a44a-5c1e4c253649 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:24.810520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d18a65-9bcf-4059-a79f-d96d2ba52b16 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:24.846642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676c930-19b7-4eb4-8e97-7de689ca06d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:24.847835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676c930-19b7-4eb4-8e97-7de689ca06d3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:24.848317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676c930-19b7-4eb4-8e97-7de689ca06d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:24.848709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae3955-d202-4ee9-99a4-77223eb77f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:24.849031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676c930-19b7-4eb4-8e97-7de689ca06d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:24.849349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae3955-d202-4ee9-99a4-77223eb77f62 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:24.849635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae3955-d202-4ee9-99a4-77223eb77f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:24.849914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae3955-d202-4ee9-99a4-77223eb77f62 None admin] PATH_INFO: `/v3/projects/4c86abcd712f4d4b9eee1d3978f03c08` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:24.850571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676c930-19b7-4eb4-8e97-7de689ca06d3 None admin] RBAC: Adding query filter params (role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=8364b69580ec486c8b430bf6e13ce028, user.id=2340bd445eaf442b8b01340293637271) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:24.851323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae3955-d202-4ee9-99a4-77223eb77f62 None admin] RBAC: Authorizing `identity:get_project(project_id=4c86abcd712f4d4b9eee1d3978f03c08)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:24.851564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676c930-19b7-4eb4-8e97-7de689ca06d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:24.852775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae3955-d202-4ee9-99a4-77223eb77f62 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:24.853404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676c930-19b7-4eb4-8e97-7de689ca06d3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:24.854696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 47/95] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:24 2022] GET /identity/v3/projects/4c86abcd712f4d4b9eee1d3978f03c08 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:24.861220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae3955-d202-4ee9-99a4-77223eb77f62 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:24.863886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:24 2022] GET /identity/v3/role_assignments?user.id=2340bd445eaf442b8b01340293637271&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 259 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:24.947480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:24.974482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae3955-d202-4ee9-99a4-77223eb77f62 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:25.013060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ec892-c4af-401e-bfd4-b25cbdb6674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:25.013685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ec892-c4af-401e-bfd4-b25cbdb6674e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:25.013972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ec892-c4af-401e-bfd4-b25cbdb6674e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:25.014253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ec892-c4af-401e-bfd4-b25cbdb6674e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:25.015066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ec892-c4af-401e-bfd4-b25cbdb6674e None admin] RBAC: Adding query filter params (role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=4c86abcd712f4d4b9eee1d3978f03c08, user.id=2340bd445eaf442b8b01340293637271) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:25.015388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ec892-c4af-401e-bfd4-b25cbdb6674e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:25.016842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ec892-c4af-401e-bfd4-b25cbdb6674e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:25.025175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:24 2022] GET /identity/v3/role_assignments?user.id=2340bd445eaf442b8b01340293637271&scope.project.id=4c86abcd712f4d4b9eee1d3978f03c08&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:25.688199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eb33d-e0c5-4c4f-82c4-6640ce199e21 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:25.689276 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eb33d-e0c5-4c4f-82c4-6640ce199e21 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:25.689775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eb33d-e0c5-4c4f-82c4-6640ce199e21 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:25.691360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:25.706104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb8d05-e270-4c88-be96-bbb267c85c79 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:25.707014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb8d05-e270-4c88-be96-bbb267c85c79 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:25.707512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb8d05-e270-4c88-be96-bbb267c85c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:25.736006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e6fb8d05-e270-4c88-be96-bbb267c85c79 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:25.737560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e6fb8d05-e270-4c88-be96-bbb267c85c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:25.823289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:25.934458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c8fcf-bbfc-4fd3-8f5f-51d158be2677 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:25.934777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c8fcf-bbfc-4fd3-8f5f-51d158be2677 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:25.935046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c8fcf-bbfc-4fd3-8f5f-51d158be2677 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:25.936859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 51/100] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:25.942282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77aa68-7654-414e-9468-3a22a9505234 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:25.942521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77aa68-7654-414e-9468-3a22a9505234 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:25.942810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77aa68-7654-414e-9468-3a22a9505234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:25.972914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ec77aa68-7654-414e-9468-3a22a9505234 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:25.974504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ec77aa68-7654-414e-9468-3a22a9505234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:26.040688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:26.057738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 50/101] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:26.321804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c8fcf-bbfc-4fd3-8f5f-51d158be2677 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:26.417443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:26.433689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c8fcf-bbfc-4fd3-8f5f-51d158be2677 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:26.469421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2529b82-b0d7-45d6-a96e-68dd5f633ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:26.470065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2529b82-b0d7-45d6-a96e-68dd5f633ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:26.470354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2529b82-b0d7-45d6-a96e-68dd5f633ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:26.470636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2529b82-b0d7-45d6-a96e-68dd5f633ee8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:26.481984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2529b82-b0d7-45d6-a96e-68dd5f633ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b2529b82-b0d7-45d6-a96e-68dd5f633ee8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:26.486770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:26.487695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:26.488422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 52/102] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:26.493836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77aa68-7654-414e-9468-3a22a9505234 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:26.609716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2529b82-b0d7-45d6-a96e-68dd5f633ee8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:26.659977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77aa68-7654-414e-9468-3a22a9505234 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:26.722227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:26.723019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:26.723175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:26.723413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:26.724324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:26.724636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:26.727010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:26.737229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 51/103] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:26.743677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:26.803398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2529b82-b0d7-45d6-a96e-68dd5f633ee8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:26.844183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:26.870972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06dabf-1ecb-4a8f-ae26-941c00b7cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:26.871558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06dabf-1ecb-4a8f-ae26-941c00b7cdbe None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:26.871841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06dabf-1ecb-4a8f-ae26-941c00b7cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:26.872119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06dabf-1ecb-4a8f-ae26-941c00b7cdbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:26.874024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06dabf-1ecb-4a8f-ae26-941c00b7cdbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:26.880300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06dabf-1ecb-4a8f-ae26-941c00b7cdbe None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:26.882220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 53/104] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:26.888205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06dabf-1ecb-4a8f-ae26-941c00b7cdbe None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:26.926055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:26.932834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145afe37-44a1-4db8-a05c-e72462eecf1a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:27.000335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da727-2e56-455e-94c4-30f6b9f2a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:27.001350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da727-2e56-455e-94c4-30f6b9f2a114 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:27.001833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da727-2e56-455e-94c4-30f6b9f2a114 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:27.002305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da727-2e56-455e-94c4-30f6b9f2a114 None admin] PATH_INFO: `/v3/users/e526ce62b1b94972a879f678eebed6cb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:27.025439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06dabf-1ecb-4a8f-ae26-941c00b7cdbe None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:27.026100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209da727-2e56-455e-94c4-30f6b9f2a114 None admin] RBAC: Authorizing `identity:get_user(user_id=e526ce62b1b94972a879f678eebed6cb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:27.028373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209da727-2e56-455e-94c4-30f6b9f2a114 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:27.030314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 52/105] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:26 2022] GET /identity/v3/users/e526ce62b1b94972a879f678eebed6cb => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:27.038264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da727-2e56-455e-94c4-30f6b9f2a114 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:27.081708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befab91-dddc-4df1-b60e-91da4af94151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:27.082330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befab91-dddc-4df1-b60e-91da4af94151 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:27.082612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befab91-dddc-4df1-b60e-91da4af94151 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:27.082898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befab91-dddc-4df1-b60e-91da4af94151 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:27.083582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befab91-dddc-4df1-b60e-91da4af94151 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:27.085033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befab91-dddc-4df1-b60e-91da4af94151 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:27.139910 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 54/106] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:04:26 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:04:27.148792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da727-2e56-455e-94c4-30f6b9f2a114 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:27.165595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:27.190747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50915e25-a481-4801-9980-3a0c4493d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:27.191810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915e25-a481-4801-9980-3a0c4493d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:27.192315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915e25-a481-4801-9980-3a0c4493d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:27.192784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915e25-a481-4801-9980-3a0c4493d6c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:27.269729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50915e25-a481-4801-9980-3a0c4493d6c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:27.271611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50915e25-a481-4801-9980-3a0c4493d6c7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:27.384414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 53/107] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:04:27.397238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befab91-dddc-4df1-b60e-91da4af94151 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:27.504026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:27.539989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befab91-dddc-4df1-b60e-91da4af94151 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:27.578366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f3a57-7fa2-4860-9b6e-93cbf4cc215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:27.579040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3a57-7fa2-4860-9b6e-93cbf4cc215d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:27.579357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3a57-7fa2-4860-9b6e-93cbf4cc215d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:27.579636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f3a57-7fa2-4860-9b6e-93cbf4cc215d None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:27.580844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f3a57-7fa2-4860-9b6e-93cbf4cc215d None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:27.582323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f3a57-7fa2-4860-9b6e-93cbf4cc215d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:27.584238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 55/108] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:27 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:27.590110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50915e25-a481-4801-9980-3a0c4493d6c7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:27.606370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:27.712839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50915e25-a481-4801-9980-3a0c4493d6c7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:27.718350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc926365-a13a-4b94-8f0d-692e8f19b149 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:27.718635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc926365-a13a-4b94-8f0d-692e8f19b149 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:27.718910 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc926365-a13a-4b94-8f0d-692e8f19b149 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:27.720450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 56/109] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:27.725189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569321-b8fe-47d5-8630-955018dee548 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:27.725473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569321-b8fe-47d5-8630-955018dee548 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:27.725751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569321-b8fe-47d5-8630-955018dee548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:27.753701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3d569321-b8fe-47d5-8630-955018dee548 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:27.754905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3d569321-b8fe-47d5-8630-955018dee548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:27.812708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8709448-9ab1-4a09-ba70-1c38f091e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:27.813359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8709448-9ab1-4a09-ba70-1c38f091e0aa None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:27.813613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8709448-9ab1-4a09-ba70-1c38f091e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:27.813896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8709448-9ab1-4a09-ba70-1c38f091e0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:27.814636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8709448-9ab1-4a09-ba70-1c38f091e0aa None admin] RBAC: Adding query filter params (role.id=00e163951e5f442fba065051ae50ed7d, scope.project.id=8364b69580ec486c8b430bf6e13ce028, user.id=e526ce62b1b94972a879f678eebed6cb) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:27.814954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8709448-9ab1-4a09-ba70-1c38f091e0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:27.816525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8709448-9ab1-4a09-ba70-1c38f091e0aa None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:27.845707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:27 2022] GET /identity/v3/role_assignments?user.id=e526ce62b1b94972a879f678eebed6cb&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=00e163951e5f442fba065051ae50ed7d => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:27.885545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 57/111] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:28.039575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989edbf-c654-4b2e-b92c-8d52f6abd07d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.040224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989edbf-c654-4b2e-b92c-8d52f6abd07d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.040889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989edbf-c654-4b2e-b92c-8d52f6abd07d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.042681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 55/112] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:28.049188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5916-9e48-44df-ae93-06c5fe97c69b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.049473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5916-9e48-44df-ae93-06c5fe97c69b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.049748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d5916-9e48-44df-ae93-06c5fe97c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.072281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-002d5916-9e48-44df-ae93-06c5fe97c69b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:28.073920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-002d5916-9e48-44df-ae93-06c5fe97c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:28.153299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:28.162108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 58/113] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:28.381897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989edbf-c654-4b2e-b92c-8d52f6abd07d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:28.398393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639683-2e05-4182-81d1-8793d2893231 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.398940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639683-2e05-4182-81d1-8793d2893231 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.398940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78639683-2e05-4182-81d1-8793d2893231 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.400494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 59/114] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:28.424357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4dae6-6e18-4cb0-ae31-9f85df017725 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.424646 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4dae6-6e18-4cb0-ae31-9f85df017725 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.424929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4dae6-6e18-4cb0-ae31-9f85df017725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.476303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-57f4dae6-6e18-4cb0-ae31-9f85df017725 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:28.477528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-57f4dae6-6e18-4cb0-ae31-9f85df017725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:28.504076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:28.539172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989edbf-c654-4b2e-b92c-8d52f6abd07d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:28.574081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 60/115] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:28.576009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6cb31-8741-403a-8795-dcfc003945b6 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.576441 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeac76-d525-4a18-a970-a0b6a5e6bfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:28.576776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6cb31-8741-403a-8795-dcfc003945b6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.577083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeac76-d525-4a18-a970-a0b6a5e6bfa7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.577369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeac76-d525-4a18-a970-a0b6a5e6bfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.577656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeac76-d525-4a18-a970-a0b6a5e6bfa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.577768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6cb31-8741-403a-8795-dcfc003945b6 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.579589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 61/116] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:28.580592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6cb31-8741-403a-8795-dcfc003945b6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:28.594368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeac76-d525-4a18-a970-a0b6a5e6bfa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-5dbeac76-d525-4a18-a970-a0b6a5e6bfa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:28.599831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:28.600684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:28.601679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 56/117] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:28.603091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a742ad-4506-4e6d-8894-6f5189b1a740 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.603091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a742ad-4506-4e6d-8894-6f5189b1a740 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.603091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a742ad-4506-4e6d-8894-6f5189b1a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.644225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b3a742ad-4506-4e6d-8894-6f5189b1a740 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:28.645378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b3a742ad-4506-4e6d-8894-6f5189b1a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:28.695596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6cb31-8741-403a-8795-dcfc003945b6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:28.725672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:28.736586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4e060-6c21-48e4-bf3b-5daf532c91b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:28.737612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4e060-6c21-48e4-bf3b-5daf532c91b9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.738134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4e060-6c21-48e4-bf3b-5daf532c91b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.738606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4e060-6c21-48e4-bf3b-5daf532c91b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.741735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 57/118] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:28.750281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a742ad-4506-4e6d-8894-6f5189b1a740 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:28.750673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4e060-6c21-48e4-bf3b-5daf532c91b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-35e4e060-6c21-48e4-bf3b-5daf532c91b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:28.756044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:28.756869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:28.757612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:28.764764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 62/119] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:04:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:28.766286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4e060-6c21-48e4-bf3b-5daf532c91b9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:28.856021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:28.876794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4e060-6c21-48e4-bf3b-5daf532c91b9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:28.913979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:28.914571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a742ad-4506-4e6d-8894-6f5189b1a740 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:28.915599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.916081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.916617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.917546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:28.918051 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:28.919673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:28.930358 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 63/120] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:04:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:28.936595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:28.973563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:28.974409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:28.974839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:28.975297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:28.976485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:28.976995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:28.978565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:28.994339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:28.997365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 58/121] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:28.998331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.045705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290ef26-462e-4caf-a41d-8a8905f1ace1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.084288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132f030-4e84-4f1d-bd7e-389d03a32920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.084835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132f030-4e84-4f1d-bd7e-389d03a32920 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.085222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132f030-4e84-4f1d-bd7e-389d03a32920 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.085597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132f030-4e84-4f1d-bd7e-389d03a32920 None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.090460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132f030-4e84-4f1d-bd7e-389d03a32920 None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:29.090460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132f030-4e84-4f1d-bd7e-389d03a32920 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:29.095564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 64/122] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:28 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:29.096751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132f030-4e84-4f1d-bd7e-389d03a32920 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.211312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132f030-4e84-4f1d-bd7e-389d03a32920 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.235357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:29.250362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58418186-e3a0-4d90-a1e6-47013d14cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.251198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418186-e3a0-4d90-a1e6-47013d14cae5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.251616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418186-e3a0-4d90-a1e6-47013d14cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.251996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418186-e3a0-4d90-a1e6-47013d14cae5 None admin] PATH_INFO: `/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.253981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58418186-e3a0-4d90-a1e6-47013d14cae5 None admin] RBAC: Authorizing `identity:get_user(user_id=332f1f7a6eb8406bb2e4f9921b706cc7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:29.255748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58418186-e3a0-4d90-a1e6-47013d14cae5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:29.258183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 65/123] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:29 2022] GET /identity/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:29.259615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58418186-e3a0-4d90-a1e6-47013d14cae5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.272539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ad34f-43f4-497b-bc1c-6671c6583382 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.314268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:29.324260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12369d-a71f-4fb9-9e15-9fe9f45275cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.325081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12369d-a71f-4fb9-9e15-9fe9f45275cf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.325511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12369d-a71f-4fb9-9e15-9fe9f45275cf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.325924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12369d-a71f-4fb9-9e15-9fe9f45275cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.336533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12369d-a71f-4fb9-9e15-9fe9f45275cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-5f12369d-a71f-4fb9-9e15-9fe9f45275cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:29.342620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:29.343601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:29.344342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:29.345404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 59/124] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:29.346274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12369d-a71f-4fb9-9e15-9fe9f45275cf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.392531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58418186-e3a0-4d90-a1e6-47013d14cae5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.432165 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1362e3-1c40-4601-91bd-a49b226212e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.433650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1362e3-1c40-4601-91bd-a49b226212e8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.434138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1362e3-1c40-4601-91bd-a49b226212e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.434751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1362e3-1c40-4601-91bd-a49b226212e8 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.439849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1362e3-1c40-4601-91bd-a49b226212e8 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:29.441592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1362e3-1c40-4601-91bd-a49b226212e8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:29.443473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 66/125] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:29 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:29.444338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1362e3-1c40-4601-91bd-a49b226212e8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.468779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12369d-a71f-4fb9-9e15-9fe9f45275cf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.502471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:29.508707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56b402-beb8-4d78-b735-b530c322147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.509632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56b402-beb8-4d78-b735-b530c322147a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.510285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56b402-beb8-4d78-b735-b530c322147a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.510737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56b402-beb8-4d78-b735-b530c322147a None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.513243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56b402-beb8-4d78-b735-b530c322147a None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:29.514979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56b402-beb8-4d78-b735-b530c322147a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:29.516998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 60/126] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:29 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:29.517729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56b402-beb8-4d78-b735-b530c322147a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.563520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1362e3-1c40-4601-91bd-a49b226212e8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.583169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:29.609050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0485a6e-abe0-4432-8833-2157bc27c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.610032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0485a6e-abe0-4432-8833-2157bc27c57e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.610504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0485a6e-abe0-4432-8833-2157bc27c57e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.610958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0485a6e-abe0-4432-8833-2157bc27c57e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.623240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0485a6e-abe0-4432-8833-2157bc27c57e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e0485a6e-abe0-4432-8833-2157bc27c57e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:29.629430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:29.630268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:29.631044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:29.633332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 67/127] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:29.638174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56b402-beb8-4d78-b735-b530c322147a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.639467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0485a6e-abe0-4432-8833-2157bc27c57e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.672910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.673458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.673813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.674159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.674891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:29.675295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:29.676928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:29.686544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 61/128] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:29.691672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.756698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0485a6e-abe0-4432-8833-2157bc27c57e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.771629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:29.800119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10052f-3ba7-447a-ad04-276cf0a2e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.801479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10052f-3ba7-447a-ad04-276cf0a2e155 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.801945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10052f-3ba7-447a-ad04-276cf0a2e155 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.802404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10052f-3ba7-447a-ad04-276cf0a2e155 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028/users/2340bd445eaf442b8b01340293637271/roles/377207058e944d2a91e7afd0f3c46025` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.805983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10052f-3ba7-447a-ad04-276cf0a2e155 None admin] RBAC: Authorizing `identity:create_grant(project_id=8364b69580ec486c8b430bf6e13ce028, user_id=2340bd445eaf442b8b01340293637271, role_id=377207058e944d2a91e7afd0f3c46025)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:29.808758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10052f-3ba7-447a-ad04-276cf0a2e155 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:29.811033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72ac5c-6a78-46df-ab25-eb47d88c9e7c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:29.827784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 68/129] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:29 2022] PUT /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028/users/2340bd445eaf442b8b01340293637271/roles/377207058e944d2a91e7afd0f3c46025 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:29.829298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10052f-3ba7-447a-ad04-276cf0a2e155 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:29.838474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:29.860855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d4ff7-a03a-49d4-bb01-55f153f24938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:29.861711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4ff7-a03a-49d4-bb01-55f153f24938 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:29.862093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4ff7-a03a-49d4-bb01-55f153f24938 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:29.862504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d4ff7-a03a-49d4-bb01-55f153f24938 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028/users/332f1f7a6eb8406bb2e4f9921b706cc7/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:29.864747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d4ff7-a03a-49d4-bb01-55f153f24938 None admin] RBAC: Authorizing `identity:create_grant(project_id=8364b69580ec486c8b430bf6e13ce028, user_id=332f1f7a6eb8406bb2e4f9921b706cc7, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:29.866405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d4ff7-a03a-49d4-bb01-55f153f24938 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:29.894723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 62/130] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:29 2022] PUT /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028/users/332f1f7a6eb8406bb2e4f9921b706cc7/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:29.899541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d4ff7-a03a-49d4-bb01-55f153f24938 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:30.052154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d4ff7-a03a-49d4-bb01-55f153f24938 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:30.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10052f-3ba7-447a-ad04-276cf0a2e155 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:30.128721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874559f1-eb65-4c1c-9574-6cd33c7848ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:30.129384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874559f1-eb65-4c1c-9574-6cd33c7848ca None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.129669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874559f1-eb65-4c1c-9574-6cd33c7848ca None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.129949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874559f1-eb65-4c1c-9574-6cd33c7848ca None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.131194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874559f1-eb65-4c1c-9574-6cd33c7848ca None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:30.132666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874559f1-eb65-4c1c-9574-6cd33c7848ca None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:30.134307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 63/131] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:29 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:30.140274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874559f1-eb65-4c1c-9574-6cd33c7848ca None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:30.182776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:30.183593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.183887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.184162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.184847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:30.185158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:30.186659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:30.201315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 69/132] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:30.207638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:30.241344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:30.255447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:30.306482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874559f1-eb65-4c1c-9574-6cd33c7848ca None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:30.345540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32c618-60f3-46a3-9a09-797fcc6db6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:30.346704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32c618-60f3-46a3-9a09-797fcc6db6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.347583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32c618-60f3-46a3-9a09-797fcc6db6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.348172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32c618-60f3-46a3-9a09-797fcc6db6f7 None admin] PATH_INFO: `/v3/projects/4c86abcd712f4d4b9eee1d3978f03c08` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.349656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32c618-60f3-46a3-9a09-797fcc6db6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=4c86abcd712f4d4b9eee1d3978f03c08)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:30.351724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32c618-60f3-46a3-9a09-797fcc6db6f7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:30.353370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59e469-ab4a-4af0-a20b-ddf59faf9617 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:30.353770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 64/133] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:30 2022] GET /identity/v3/projects/4c86abcd712f4d4b9eee1d3978f03c08 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:30.355793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908aaa-ef3e-4cfc-b05b-b99c45667fbe None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.356235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908aaa-ef3e-4cfc-b05b-b99c45667fbe None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.356655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e908aaa-ef3e-4cfc-b05b-b99c45667fbe None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.358070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 65/134] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:30.363644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb9ab-415d-4594-91b9-d689cbcca4fa None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.364103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb9ab-415d-4594-91b9-d689cbcca4fa None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.364525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb9ab-415d-4594-91b9-d689cbcca4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.403362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1bfbb9ab-415d-4594-91b9-d689cbcca4fa None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:30.404827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1bfbb9ab-415d-4594-91b9-d689cbcca4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:30.429290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b3708-1d29-4b3c-a023-6f2a4ee8e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:30.430166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b3708-1d29-4b3c-a023-6f2a4ee8e21f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.430591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b3708-1d29-4b3c-a023-6f2a4ee8e21f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.431023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b3708-1d29-4b3c-a023-6f2a4ee8e21f None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.433224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b3708-1d29-4b3c-a023-6f2a4ee8e21f None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:30.434900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b3708-1d29-4b3c-a023-6f2a4ee8e21f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:30.437616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 70/135] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:30 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:30.440301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b3708-1d29-4b3c-a023-6f2a4ee8e21f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:30.560346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 66/136] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:30.563587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbb9ab-415d-4594-91b9-d689cbcca4fa None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:30.601058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b3708-1d29-4b3c-a023-6f2a4ee8e21f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:30.612667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:30.641261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:30.705609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdc549-b207-411e-b162-316b9743b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:30.705844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbb9ab-415d-4594-91b9-d689cbcca4fa None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:30.706786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc549-b207-411e-b162-316b9743b1fe None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.707343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc549-b207-411e-b162-316b9743b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.707767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc549-b207-411e-b162-316b9743b1fe None admin] PATH_INFO: `/v3/projects/4c86abcd712f4d4b9eee1d3978f03c08/users/2340bd445eaf442b8b01340293637271/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.712307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdc549-b207-411e-b162-316b9743b1fe None admin] RBAC: Authorizing `identity:create_grant(project_id=4c86abcd712f4d4b9eee1d3978f03c08, user_id=2340bd445eaf442b8b01340293637271, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:30.714450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdc549-b207-411e-b162-316b9743b1fe None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:30.744933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188a50-9d89-4f83-9cfd-0bea38285794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:30.745638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188a50-9d89-4f83-9cfd-0bea38285794 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.745927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188a50-9d89-4f83-9cfd-0bea38285794 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.746204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188a50-9d89-4f83-9cfd-0bea38285794 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.747485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188a50-9d89-4f83-9cfd-0bea38285794 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:30.747881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 71/137] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:30 2022] PUT /identity/v3/projects/4c86abcd712f4d4b9eee1d3978f03c08/users/2340bd445eaf442b8b01340293637271/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:30.749139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188a50-9d89-4f83-9cfd-0bea38285794 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:30.750980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 67/138] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:30 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:30.757064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdc549-b207-411e-b162-316b9743b1fe None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:30.902069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdc549-b207-411e-b162-316b9743b1fe None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:30.915619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4e4c-9590-4aec-8d40-ceb01e106a56 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.916116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4e4c-9590-4aec-8d40-ceb01e106a56 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.916435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa4e4c-9590-4aec-8d40-ceb01e106a56 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.917937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 68/139] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:30.928680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fdfca-46eb-4623-b47e-6d23a7d9a3bd None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.928969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fdfca-46eb-4623-b47e-6d23a7d9a3bd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.929255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fdfca-46eb-4623-b47e-6d23a7d9a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.940487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466978f-e4fb-4b68-b9ce-40e13b1146c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:30.941254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466978f-e4fb-4b68-b9ce-40e13b1146c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:30.941542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466978f-e4fb-4b68-b9ce-40e13b1146c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:30.941826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466978f-e4fb-4b68-b9ce-40e13b1146c6 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028/users/2340bd445eaf442b8b01340293637271/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:30.943964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466978f-e4fb-4b68-b9ce-40e13b1146c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8364b69580ec486c8b430bf6e13ce028, user_id=2340bd445eaf442b8b01340293637271, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:30.945433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466978f-e4fb-4b68-b9ce-40e13b1146c6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:30.965634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 72/140] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:30 2022] PUT /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028/users/2340bd445eaf442b8b01340293637271/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:30.969570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cd4fdfca-46eb-4623-b47e-6d23a7d9a3bd None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:30.970852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cd4fdfca-46eb-4623-b47e-6d23a7d9a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:30.980227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466978f-e4fb-4b68-b9ce-40e13b1146c6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:31.031448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:31.096720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 69/141] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:31.155103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466978f-e4fb-4b68-b9ce-40e13b1146c6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:31.195179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad28383-f012-4efc-9adc-1913d701525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:31.195179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28383-f012-4efc-9adc-1913d701525e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:31.195179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28383-f012-4efc-9adc-1913d701525e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:31.195179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad28383-f012-4efc-9adc-1913d701525e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:31.195673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad28383-f012-4efc-9adc-1913d701525e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:31.195916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad28383-f012-4efc-9adc-1913d701525e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:31.197728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 73/142] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:31.212191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fdfca-46eb-4623-b47e-6d23a7d9a3bd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:31.318967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:31.381426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fdfca-46eb-4623-b47e-6d23a7d9a3bd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:31.419674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eaab0-f622-4036-8dfb-8180f1e8d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:31.420225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eaab0-f622-4036-8dfb-8180f1e8d91d None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:31.420510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eaab0-f622-4036-8dfb-8180f1e8d91d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:31.420791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eaab0-f622-4036-8dfb-8180f1e8d91d None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:31.421456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eaab0-f622-4036-8dfb-8180f1e8d91d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:31.422955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eaab0-f622-4036-8dfb-8180f1e8d91d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:31.453316 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 70/143] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:04:31 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:31.605631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad28383-f012-4efc-9adc-1913d701525e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:31.726060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:31.745377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad28383-f012-4efc-9adc-1913d701525e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:31.799724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e80982-ae1c-421b-9f52-03ebb8381095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:31.800389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e80982-ae1c-421b-9f52-03ebb8381095 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:31.800671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e80982-ae1c-421b-9f52-03ebb8381095 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:31.800944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e80982-ae1c-421b-9f52-03ebb8381095 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:31.814422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e80982-ae1c-421b-9f52-03ebb8381095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f4e80982-ae1c-421b-9f52-03ebb8381095 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:31.820123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:31.820995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:31.821836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 74/144] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:31.828185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eaab0-f622-4036-8dfb-8180f1e8d91d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:31.941707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:31.949297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eaab0-f622-4036-8dfb-8180f1e8d91d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:31.989873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:31.990471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:31.990714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:31.991010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:31.991698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:31.992007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:31.993393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:32.006482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 71/145] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:32.012583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e80982-ae1c-421b-9f52-03ebb8381095 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:32.139050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e80982-ae1c-421b-9f52-03ebb8381095 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:32.186244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a8326-5d48-4b25-ac7c-6b65bb9cc663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:32.186877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a8326-5d48-4b25-ac7c-6b65bb9cc663 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:32.187190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a8326-5d48-4b25-ac7c-6b65bb9cc663 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:32.187473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a8326-5d48-4b25-ac7c-6b65bb9cc663 None admin] PATH_INFO: `/v3/users/e526ce62b1b94972a879f678eebed6cb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:32.191676 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a8326-5d48-4b25-ac7c-6b65bb9cc663 None admin] RBAC: Authorizing `identity:get_user(user_id=e526ce62b1b94972a879f678eebed6cb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:32.193241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a8326-5d48-4b25-ac7c-6b65bb9cc663 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:32.195029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 75/146] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:32 2022] GET /identity/v3/users/e526ce62b1b94972a879f678eebed6cb => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:32.201909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:32.362267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12986b60-d367-4d04-97f3-a9960197ad64 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:32.400680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f76d69-4bf7-4c7f-ada3-9e929b823ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:32.401856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76d69-4bf7-4c7f-ada3-9e929b823ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:32.402178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76d69-4bf7-4c7f-ada3-9e929b823ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:32.402459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76d69-4bf7-4c7f-ada3-9e929b823ab3 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:32.403630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76d69-4bf7-4c7f-ada3-9e929b823ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:32.405077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76d69-4bf7-4c7f-ada3-9e929b823ab3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:32.407798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 72/147] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:32 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:32.412581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a8326-5d48-4b25-ac7c-6b65bb9cc663 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:32.465158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:32.567822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a8326-5d48-4b25-ac7c-6b65bb9cc663 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:32.615020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157293c-b74e-42b2-abd2-8d3dbd395b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:32.615593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157293c-b74e-42b2-abd2-8d3dbd395b7b None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:32.615889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157293c-b74e-42b2-abd2-8d3dbd395b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:32.616172 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157293c-b74e-42b2-abd2-8d3dbd395b7b None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028/users/e526ce62b1b94972a879f678eebed6cb/roles/00e163951e5f442fba065051ae50ed7d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:32.624379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157293c-b74e-42b2-abd2-8d3dbd395b7b None admin] RBAC: Authorizing `identity:create_grant(project_id=8364b69580ec486c8b430bf6e13ce028, user_id=e526ce62b1b94972a879f678eebed6cb, role_id=00e163951e5f442fba065051ae50ed7d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:32.626954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157293c-b74e-42b2-abd2-8d3dbd395b7b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:32.646351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 76/148] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:32 2022] PUT /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028/users/e526ce62b1b94972a879f678eebed6cb/roles/00e163951e5f442fba065051ae50ed7d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:33.202412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3ed6-eac3-4603-8623-abb591522770 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:33.203131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3ed6-eac3-4603-8623-abb591522770 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:33.203131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3ed6-eac3-4603-8623-abb591522770 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:33.204506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 73/149] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:33.217212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1666f-cca6-4154-a917-ea2a8a423c7c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:33.217722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1666f-cca6-4154-a917-ea2a8a423c7c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:33.217800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1666f-cca6-4154-a917-ea2a8a423c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:33.238352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3af1666f-cca6-4154-a917-ea2a8a423c7c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:33.239875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3af1666f-cca6-4154-a917-ea2a8a423c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:33.317741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 77/150] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:33.636779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d068-d190-4585-ba96-b5c128a1c285 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:33.636962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d068-d190-4585-ba96-b5c128a1c285 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:33.637238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d068-d190-4585-ba96-b5c128a1c285 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:33.638713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 74/151] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:33.644199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350284-03de-4b7a-903b-9d528e07576d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:33.644487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350284-03de-4b7a-903b-9d528e07576d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:33.644762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8350284-03de-4b7a-903b-9d528e07576d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:33.668559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c8350284-03de-4b7a-903b-9d528e07576d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:33.669758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c8350284-03de-4b7a-903b-9d528e07576d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:33.672152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:33.752302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 78/152] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:33.977193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d068-d190-4585-ba96-b5c128a1c285 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:34.014082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:34.103292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d068-d190-4585-ba96-b5c128a1c285 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:34.149107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964549c-0d77-4047-a5ec-bae72d2ef0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:34.149800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964549c-0d77-4047-a5ec-bae72d2ef0fb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:34.150087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964549c-0d77-4047-a5ec-bae72d2ef0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:34.150366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964549c-0d77-4047-a5ec-bae72d2ef0fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:34.166249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964549c-0d77-4047-a5ec-bae72d2ef0fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-3964549c-0d77-4047-a5ec-bae72d2ef0fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:34.171349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:34.172162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:34.172889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 75/153] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:04:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:34.179782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8350284-03de-4b7a-903b-9d528e07576d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:34.296368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8350284-03de-4b7a-903b-9d528e07576d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:34.335416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:34.336041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:34.336319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:34.336596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:34.337278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:34.337581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:34.339058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:34.347206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:34.351132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 79/154] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:04:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:34.357850 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964549c-0d77-4047-a5ec-bae72d2ef0fb None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:34.433587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:34.505855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:34.538507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964549c-0d77-4047-a5ec-bae72d2ef0fb None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:34.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d3cd0-c875-485e-a55a-8fecefb412ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:34.619281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d3cd0-c875-485e-a55a-8fecefb412ec None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:34.619568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d3cd0-c875-485e-a55a-8fecefb412ec None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:34.619848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d3cd0-c875-485e-a55a-8fecefb412ec None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:34.624427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d3cd0-c875-485e-a55a-8fecefb412ec None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:34.625934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d3cd0-c875-485e-a55a-8fecefb412ec None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:34.627879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 76/155] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:34 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:34.633635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d3cd0-c875-485e-a55a-8fecefb412ec None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:34.659423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2895158-4777-454b-a5a7-f3c17a4d982f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:34.710826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7faed-a8f3-4680-9bf4-ca85d7a75194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:34.711498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7faed-a8f3-4680-9bf4-ca85d7a75194 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:34.711779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7faed-a8f3-4680-9bf4-ca85d7a75194 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:34.712939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7faed-a8f3-4680-9bf4-ca85d7a75194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:34.732220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7faed-a8f3-4680-9bf4-ca85d7a75194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-49b7faed-a8f3-4680-9bf4-ca85d7a75194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:34.738115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:34.739183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:34.740015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 80/156] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:04:34.749119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7faed-a8f3-4680-9bf4-ca85d7a75194 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:34.850976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:34.874054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d3cd0-c875-485e-a55a-8fecefb412ec None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:34.922078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7faed-a8f3-4680-9bf4-ca85d7a75194 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:34.951288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979443b5-12ef-4ad9-9327-12c0e96b4c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:34.951926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979443b5-12ef-4ad9-9327-12c0e96b4c75 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:34.952207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979443b5-12ef-4ad9-9327-12c0e96b4c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:34.952487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979443b5-12ef-4ad9-9327-12c0e96b4c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:34.985984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:34.986898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:34.987363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:34.987796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:34.988699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:34.989155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:34.990709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:35.002375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:35.007771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 81/157] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:35.017987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:35.103992 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979443b5-12ef-4ad9-9327-12c0e96b4c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:35.106486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979443b5-12ef-4ad9-9327-12c0e96b4c75 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:35.190889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d87e0-0b54-404d-8cb2-e5ba15b3b417 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:35.222706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:35.245267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d9c48-72de-4f94-9fcd-6fc875eb16a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:35.246384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9c48-72de-4f94-9fcd-6fc875eb16a1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:35.246968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9c48-72de-4f94-9fcd-6fc875eb16a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:35.247458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9c48-72de-4f94-9fcd-6fc875eb16a1 None admin] PATH_INFO: `/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:35.251667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d9c48-72de-4f94-9fcd-6fc875eb16a1 None admin] RBAC: Authorizing `identity:get_user(user_id=332f1f7a6eb8406bb2e4f9921b706cc7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:35.253434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d9c48-72de-4f94-9fcd-6fc875eb16a1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:35.255706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 82/158] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:35 2022] GET /identity/v3/users/332f1f7a6eb8406bb2e4f9921b706cc7 => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:35.261891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d9c48-72de-4f94-9fcd-6fc875eb16a1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:35.321808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 77/159] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:04:35.329046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979443b5-12ef-4ad9-9327-12c0e96b4c75 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:35.473205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d9c48-72de-4f94-9fcd-6fc875eb16a1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:35.474880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:35.532620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f70fd-d912-43c8-8837-4537536e2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:35.533248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f70fd-d912-43c8-8837-4537536e2dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:35.533529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f70fd-d912-43c8-8837-4537536e2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:35.533803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f70fd-d912-43c8-8837-4537536e2dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:35.593121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979443b5-12ef-4ad9-9327-12c0e96b4c75 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:35.644220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:35.666359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f70fd-d912-43c8-8837-4537536e2dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:35.668919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f70fd-d912-43c8-8837-4537536e2dc5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:35.680623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967c2d8-c0d5-4703-ab6c-221a9361ece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:35.681268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967c2d8-c0d5-4703-ab6c-221a9361ece5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:35.681550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967c2d8-c0d5-4703-ab6c-221a9361ece5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:35.681832 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967c2d8-c0d5-4703-ab6c-221a9361ece5 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:35.683098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967c2d8-c0d5-4703-ab6c-221a9361ece5 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:35.684887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967c2d8-c0d5-4703-ab6c-221a9361ece5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:35.695100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 78/160] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:35 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:35.696473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f905-56e3-4c92-a309-44f7f7cb4457 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:35.696757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f905-56e3-4c92-a309-44f7f7cb4457 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:35.697094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f905-56e3-4c92-a309-44f7f7cb4457 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:35.699108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 79/161] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:35.700538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51328211-d024-4739-b074-652d3d35d652 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:35.700880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51328211-d024-4739-b074-652d3d35d652 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:35.701164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51328211-d024-4739-b074-652d3d35d652 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:35.702527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 80/162] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:35.703473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51328211-d024-4739-b074-652d3d35d652 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:35.836297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 83/163] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:04:35.837997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d5844-97da-432f-a72e-06cb476bf878 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:35.838344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d5844-97da-432f-a72e-06cb476bf878 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:35.839108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d5844-97da-432f-a72e-06cb476bf878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:35.871421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-719d5844-97da-432f-a72e-06cb476bf878 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:35.872717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-719d5844-97da-432f-a72e-06cb476bf878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:35.932767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51328211-d024-4739-b074-652d3d35d652 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:35.981983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:36.000503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 84/164] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:36.001972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890839de-896b-4d47-9aec-9f75cecce73a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:36.002422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890839de-896b-4d47-9aec-9f75cecce73a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:36.002768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890839de-896b-4d47-9aec-9f75cecce73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:36.005863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:36.006697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:36.007173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:36.007614 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:36.008506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] RBAC: Adding query filter params (role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=8364b69580ec486c8b430bf6e13ce028, user.id=2340bd445eaf442b8b01340293637271) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:36.008997 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:36.010612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:36.024697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 81/165] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:35 2022] GET /identity/v3/role_assignments?user.id=2340bd445eaf442b8b01340293637271&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=377207058e944d2a91e7afd0f3c46025 => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:36.025820 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:36.037442 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-890839de-896b-4d47-9aec-9f75cecce73a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:36.043024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-890839de-896b-4d47-9aec-9f75cecce73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:36.069598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:36.173815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 85/166] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:36.223956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987801-c05c-4067-b9e2-8a65d98409d9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:36.265313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec97ed6-5a14-4943-a7f7-80a41f3aabcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:36.266034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec97ed6-5a14-4943-a7f7-80a41f3aabcc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:36.266313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec97ed6-5a14-4943-a7f7-80a41f3aabcc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:36.266590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec97ed6-5a14-4943-a7f7-80a41f3aabcc None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:36.267817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec97ed6-5a14-4943-a7f7-80a41f3aabcc None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:36.269287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec97ed6-5a14-4943-a7f7-80a41f3aabcc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:36.270985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 82/167] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:36 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:36.277793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890839de-896b-4d47-9aec-9f75cecce73a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:36.402358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7779-50ed-4654-9d4a-d17c2926b2a0 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:36.402684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7779-50ed-4654-9d4a-d17c2926b2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:36.403529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7779-50ed-4654-9d4a-d17c2926b2a0 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:36.405298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 83/168] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:36.408434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890839de-896b-4d47-9aec-9f75cecce73a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:36.410612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f5f4-378a-4e33-a05b-154913b27e8e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:36.411082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f5f4-378a-4e33-a05b-154913b27e8e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:36.411503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f5f4-378a-4e33-a05b-154913b27e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:36.443413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7944f5f4-378a-4e33-a05b-154913b27e8e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:36.444631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7944f5f4-378a-4e33-a05b-154913b27e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:36.478091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:36.479974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:36.480426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:36.480893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:36.481808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=8364b69580ec486c8b430bf6e13ce028, user.id=332f1f7a6eb8406bb2e4f9921b706cc7) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:36.482563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:36.484612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:36.497358 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 86/169] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:36 2022] GET /identity/v3/role_assignments?user.id=332f1f7a6eb8406bb2e4f9921b706cc7&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=0f99070a6a88400199520fccd98977b6 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:36.545888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:36.565225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 84/170] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:36.627440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:36.646293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:36.750367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaac246-29ab-494c-9ca3-5ee79d8533f9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:36.792016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea018d-8e7a-449f-a783-d2fa65eadbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:36.793029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea018d-8e7a-449f-a783-d2fa65eadbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:36.793501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea018d-8e7a-449f-a783-d2fa65eadbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:36.793993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea018d-8e7a-449f-a783-d2fa65eadbd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:36.805654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea018d-8e7a-449f-a783-d2fa65eadbd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-30ea018d-8e7a-449f-a783-d2fa65eadbd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:36.812340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:36.813278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:36.814039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:36.814917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944f5f4-378a-4e33-a05b-154913b27e8e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:36.816670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 87/171] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:36.823502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea018d-8e7a-449f-a783-d2fa65eadbd5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:36.934498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:36.961321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944f5f4-378a-4e33-a05b-154913b27e8e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:36.977286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea018d-8e7a-449f-a783-d2fa65eadbd5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:37.032343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ec7a6-e0b8-4991-9bd7-5736a9410771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.032970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec7a6-e0b8-4991-9bd7-5736a9410771 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.033253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec7a6-e0b8-4991-9bd7-5736a9410771 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.033525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec7a6-e0b8-4991-9bd7-5736a9410771 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.047903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.048852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.049143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.049497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.050242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:37.050554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:37.052068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:37.061104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ec7a6-e0b8-4991-9bd7-5736a9410771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-fa1ec7a6-e0b8-4991-9bd7-5736a9410771 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:37.071160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:37.072170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:37.073440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 85/172] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:04:37.075461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 88/173] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:37.080513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ec7a6-e0b8-4991-9bd7-5736a9410771 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:37.081793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:37.137277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:37.205705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ec7a6-e0b8-4991-9bd7-5736a9410771 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:37.248569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5aa0f-ead6-40ac-8db5-315ef92da3c8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:37.250111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.251637 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.251931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.252210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.252879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:37.253185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:37.254626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:37.265793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 86/174] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:37.266605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:37.290051 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691132be-b820-457e-a7cd-5b01218961b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.290620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691132be-b820-457e-a7cd-5b01218961b4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.290899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691132be-b820-457e-a7cd-5b01218961b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.291220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691132be-b820-457e-a7cd-5b01218961b4 None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.293003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691132be-b820-457e-a7cd-5b01218961b4 None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:37.294677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691132be-b820-457e-a7cd-5b01218961b4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:37.296574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 89/175] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:37 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:37.297798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd98b-5c6a-458f-a5b2-33f1038240c4 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.298093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd98b-5c6a-458f-a5b2-33f1038240c4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.298460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd98b-5c6a-458f-a5b2-33f1038240c4 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.300018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 90/176] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:37.304815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd98b-5c6a-458f-a5b2-33f1038240c4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:37.305000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:37.396726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ca92a-5da8-4a96-8963-add9b981f347 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:37.409621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:37.430060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd98b-5c6a-458f-a5b2-33f1038240c4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:37.446497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfac7e-b757-4ac0-8306-855cb6c1b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.447169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfac7e-b757-4ac0-8306-855cb6c1b075 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.447456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfac7e-b757-4ac0-8306-855cb6c1b075 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.447734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfac7e-b757-4ac0-8306-855cb6c1b075 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.458556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfac7e-b757-4ac0-8306-855cb6c1b075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a8bfac7e-b757-4ac0-8306-855cb6c1b075 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:37.464035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:37.465251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:37.466015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 87/177] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:37.466647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfac7e-b757-4ac0-8306-855cb6c1b075 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:37.472483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3d917-3ae8-494d-bf9b-c61f2f994003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.473129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d917-3ae8-494d-bf9b-c61f2f994003 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.473406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d917-3ae8-494d-bf9b-c61f2f994003 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.473680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3d917-3ae8-494d-bf9b-c61f2f994003 None admin] PATH_INFO: `/v3/users/2340bd445eaf442b8b01340293637271` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.474793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d917-3ae8-494d-bf9b-c61f2f994003 None admin] RBAC: Authorizing `identity:get_user(user_id=2340bd445eaf442b8b01340293637271)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:37.476608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3d917-3ae8-494d-bf9b-c61f2f994003 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:37.478192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 91/178] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:37 2022] GET /identity/v3/users/2340bd445eaf442b8b01340293637271 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:37.479312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6efd48-46fc-4f51-8680-61a3765d274c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.480155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6efd48-46fc-4f51-8680-61a3765d274c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.480420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6efd48-46fc-4f51-8680-61a3765d274c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.500452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ca6efd48-46fc-4f51-8680-61a3765d274c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:37.501628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ca6efd48-46fc-4f51-8680-61a3765d274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:37.567995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 92/179] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:37.569230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014c76-6063-49e5-b568-541797c76d67 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.569525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014c76-6063-49e5-b568-541797c76d67 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.569802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf014c76-6063-49e5-b568-541797c76d67 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.575427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 93/180] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:37.575427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf014c76-6063-49e5-b568-541797c76d67 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:37.575427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:37.580575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfac7e-b757-4ac0-8306-855cb6c1b075 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:37.621326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5722bc-83a9-4768-936a-27fbae3b0d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.622156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5722bc-83a9-4768-936a-27fbae3b0d79 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.622605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5722bc-83a9-4768-936a-27fbae3b0d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.623082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5722bc-83a9-4768-936a-27fbae3b0d79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.660213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:37.678041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf014c76-6063-49e5-b568-541797c76d67 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:37.696231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5722bc-83a9-4768-936a-27fbae3b0d79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:37.697688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5722bc-83a9-4768-936a-27fbae3b0d79 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:37.712873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.713479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.713812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.714132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.714874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:37.715205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:37.716575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:37.724553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 94/181] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:37.729461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:37.791072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:37.809472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 88/182] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:37.809472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beaa75-eb90-4336-8065-58eeb7f43ed0 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.809472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beaa75-eb90-4336-8065-58eeb7f43ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.809472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beaa75-eb90-4336-8065-58eeb7f43ed0 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.809472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 89/183] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:37.817910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2489f-c0b4-4c11-b2a3-6f87e1a00eb4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.818485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2489f-c0b4-4c11-b2a3-6f87e1a00eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.818485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d2489f-c0b4-4c11-b2a3-6f87e1a00eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.836474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-32d2489f-c0b4-4c11-b2a3-6f87e1a00eb4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:37.837357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238bdc8-f2e9-4b38-9add-fd814f54f7cd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:37.837649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-32d2489f-c0b4-4c11-b2a3-6f87e1a00eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:37.872892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa90fb9-be10-4c4e-b52d-e4736390f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:37.873500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa90fb9-be10-4c4e-b52d-e4736390f2dc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:37.873776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa90fb9-be10-4c4e-b52d-e4736390f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:37.874045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa90fb9-be10-4c4e-b52d-e4736390f2dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:37.902516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:37.907796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 90/184] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:37.915155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2489f-c0b4-4c11-b2a3-6f87e1a00eb4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:37.942234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa90fb9-be10-4c4e-b52d-e4736390f2dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:37.943738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa90fb9-be10-4c4e-b52d-e4736390f2dc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:38.004398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.018116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d2489f-c0b4-4c11-b2a3-6f87e1a00eb4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.053437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 95/185] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:38.053437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa90fb9-be10-4c4e-b52d-e4736390f2dc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.059849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77404bf1-76e6-42ab-94ad-bfa5e106a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.060496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77404bf1-76e6-42ab-94ad-bfa5e106a158 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.060778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77404bf1-76e6-42ab-94ad-bfa5e106a158 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.061058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77404bf1-76e6-42ab-94ad-bfa5e106a158 None admin] PATH_INFO: `/v3/users/0392bf2120f944138760768dc5793e34` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.076229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77404bf1-76e6-42ab-94ad-bfa5e106a158 None admin] RBAC: Authorizing `identity:get_user(user_id=0392bf2120f944138760768dc5793e34)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:38.077630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77404bf1-76e6-42ab-94ad-bfa5e106a158 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:38.079467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 91/186] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:37 2022] GET /identity/v3/users/0392bf2120f944138760768dc5793e34 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:38.084415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56238379-1ac6-4af4-92eb-0802bfd3ac10 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.084822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56238379-1ac6-4af4-92eb-0802bfd3ac10 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.085172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56238379-1ac6-4af4-92eb-0802bfd3ac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.103490 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-56238379-1ac6-4af4-92eb-0802bfd3ac10 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:38.105183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-56238379-1ac6-4af4-92eb-0802bfd3ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:38.153424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa90fb9-be10-4c4e-b52d-e4736390f2dc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.162366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.181264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 92/187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:38.182105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56238379-1ac6-4af4-92eb-0802bfd3ac10 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.188818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea15f-87d1-428b-921b-87375a6ff00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.189452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea15f-87d1-428b-921b-87375a6ff00b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.189730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea15f-87d1-428b-921b-87375a6ff00b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.190006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ea15f-87d1-428b-921b-87375a6ff00b None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.191163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ea15f-87d1-428b-921b-87375a6ff00b None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:38.192622 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ea15f-87d1-428b-921b-87375a6ff00b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:38.199066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 96/188] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:38.199066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea15f-87d1-428b-921b-87375a6ff00b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.230112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.301273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56238379-1ac6-4af4-92eb-0802bfd3ac10 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.301931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ea15f-87d1-428b-921b-87375a6ff00b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.338140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb13bd-85ef-44a6-bb51-30089f6e213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.339228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb13bd-85ef-44a6-bb51-30089f6e213d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.339595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb13bd-85ef-44a6-bb51-30089f6e213d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.340042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb13bd-85ef-44a6-bb51-30089f6e213d None admin] PATH_INFO: `/v3/projects/4c86abcd712f4d4b9eee1d3978f03c08` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.341183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb13bd-85ef-44a6-bb51-30089f6e213d None admin] RBAC: Authorizing `identity:get_project(project_id=4c86abcd712f4d4b9eee1d3978f03c08)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:38.342645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb13bd-85ef-44a6-bb51-30089f6e213d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:38.343405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766258d-211f-48b7-93db-db52b23f0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.344243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766258d-211f-48b7-93db-db52b23f0e7b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.344347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 97/189] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/projects/4c86abcd712f4d4b9eee1d3978f03c08 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:38.344792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766258d-211f-48b7-93db-db52b23f0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.345061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb13bd-85ef-44a6-bb51-30089f6e213d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.345555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766258d-211f-48b7-93db-db52b23f0e7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.360117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766258d-211f-48b7-93db-db52b23f0e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-9766258d-211f-48b7-93db-db52b23f0e7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:38.365293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:38.366145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:38.366919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:38.373501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 93/190] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:38.373501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766258d-211f-48b7-93db-db52b23f0e7b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.423957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.452418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.455298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb13bd-85ef-44a6-bb51-30089f6e213d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.487330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766258d-211f-48b7-93db-db52b23f0e7b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.490362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7146a-6b3d-45b8-9154-1fa5e762acc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.490970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7146a-6b3d-45b8-9154-1fa5e762acc6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.491336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7146a-6b3d-45b8-9154-1fa5e762acc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.491609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7146a-6b3d-45b8-9154-1fa5e762acc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.521253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae31cf-e8af-49cc-977a-92b38e014526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.521880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae31cf-e8af-49cc-977a-92b38e014526 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.522167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae31cf-e8af-49cc-977a-92b38e014526 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.522444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae31cf-e8af-49cc-977a-92b38e014526 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.532657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae31cf-e8af-49cc-977a-92b38e014526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-30ae31cf-e8af-49cc-977a-92b38e014526 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:38.537440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:38.538319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:38.539315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 94/191] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:38.540413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae31cf-e8af-49cc-977a-92b38e014526 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.558557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7146a-6b3d-45b8-9154-1fa5e762acc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:38.560062 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7146a-6b3d-45b8-9154-1fa5e762acc6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:38.640207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae31cf-e8af-49cc-977a-92b38e014526 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.647441 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.656126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.664561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 98/192] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:38.665271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7146a-6b3d-45b8-9154-1fa5e762acc6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.675808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.676412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.676693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.676969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.677693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] RBAC: Adding query filter params (role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=8364b69580ec486c8b430bf6e13ce028, user.id=2340bd445eaf442b8b01340293637271) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:38.677999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:38.679473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:38.685420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 95/193] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/role_assignments?user.id=2340bd445eaf442b8b01340293637271&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:38.685420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.790049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7146a-6b3d-45b8-9154-1fa5e762acc6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.808331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe6d35-c64b-4f0c-9fa7-049f75ebc138 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:38.837670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.838559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.839423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.839711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.840756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] RBAC: Adding query filter params (role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=4c86abcd712f4d4b9eee1d3978f03c08, user.id=2340bd445eaf442b8b01340293637271) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:38.841077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:38.843344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:38.848299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:38.848931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:38.849216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:38.849496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:38.849907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 99/194] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/role_assignments?user.id=2340bd445eaf442b8b01340293637271&scope.project.id=4c86abcd712f4d4b9eee1d3978f03c08&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:38.850184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:38.850496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:38.850822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.852198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:38.871629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 96/195] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:38.871629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:38.910968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.947406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:38.996631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab88cf-dd7a-4fd2-be56-a9f968fde27d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.013646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724feb5f-0296-4754-aa88-6b9bdb8a3e26 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.035926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74f6fc-c7e6-4121-a15e-e00539dc0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.036576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74f6fc-c7e6-4121-a15e-e00539dc0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.036861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74f6fc-c7e6-4121-a15e-e00539dc0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.037138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74f6fc-c7e6-4121-a15e-e00539dc0fc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.038844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74f6fc-c7e6-4121-a15e-e00539dc0fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.040256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74f6fc-c7e6-4121-a15e-e00539dc0fc4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.042411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 100/196] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:39.042411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74f6fc-c7e6-4121-a15e-e00539dc0fc4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.055757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.056384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.056662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.056934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.058264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:39.058810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.060353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.069922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 97/197] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:04:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:39.070554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.159846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74f6fc-c7e6-4121-a15e-e00539dc0fc4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.176481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:39.183283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d250eda-7fc2-4ce8-adf9-8537a2861bc7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.189114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:39.194023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e918e2-18d9-47c7-83c4-6f4c7cfcfe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.194655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e918e2-18d9-47c7-83c4-6f4c7cfcfe3e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.195218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e918e2-18d9-47c7-83c4-6f4c7cfcfe3e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.195503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e918e2-18d9-47c7-83c4-6f4c7cfcfe3e None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.196631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e918e2-18d9-47c7-83c4-6f4c7cfcfe3e None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.198142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e918e2-18d9-47c7-83c4-6f4c7cfcfe3e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.199919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 101/198] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:39.200699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e918e2-18d9-47c7-83c4-6f4c7cfcfe3e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.218222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef698-2d5c-4fa5-9caf-25bc4981a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.218851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef698-2d5c-4fa5-9caf-25bc4981a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.219172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef698-2d5c-4fa5-9caf-25bc4981a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.219456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef698-2d5c-4fa5-9caf-25bc4981a1e3 None admin] PATH_INFO: `/v3/users/e526ce62b1b94972a879f678eebed6cb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.220623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef698-2d5c-4fa5-9caf-25bc4981a1e3 None admin] RBAC: Authorizing `identity:get_user(user_id=e526ce62b1b94972a879f678eebed6cb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.222073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef698-2d5c-4fa5-9caf-25bc4981a1e3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.223691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 98/199] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/users/e526ce62b1b94972a879f678eebed6cb => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:39.227898 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef698-2d5c-4fa5-9caf-25bc4981a1e3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.302400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e918e2-18d9-47c7-83c4-6f4c7cfcfe3e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.328452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef698-2d5c-4fa5-9caf-25bc4981a1e3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.336433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344a67-b8d6-4109-a3e3-1d32d5cf91de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.337122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344a67-b8d6-4109-a3e3-1d32d5cf91de None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.337403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344a67-b8d6-4109-a3e3-1d32d5cf91de None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.337679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344a67-b8d6-4109-a3e3-1d32d5cf91de None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.338343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344a67-b8d6-4109-a3e3-1d32d5cf91de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.340555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344a67-b8d6-4109-a3e3-1d32d5cf91de None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.362178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 102/200] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:04:39 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:39.362178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344a67-b8d6-4109-a3e3-1d32d5cf91de None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.368752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec05c4c-5e74-483b-b25e-96ae73ffe714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.369444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05c4c-5e74-483b-b25e-96ae73ffe714 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.369724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05c4c-5e74-483b-b25e-96ae73ffe714 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.370059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec05c4c-5e74-483b-b25e-96ae73ffe714 None admin] PATH_INFO: `/v3/users/0392bf2120f944138760768dc5793e34` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.371507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec05c4c-5e74-483b-b25e-96ae73ffe714 None admin] RBAC: Authorizing `identity:get_user(user_id=0392bf2120f944138760768dc5793e34)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.373012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec05c4c-5e74-483b-b25e-96ae73ffe714 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.380059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 99/201] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/users/0392bf2120f944138760768dc5793e34 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:39.380059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec05c4c-5e74-483b-b25e-96ae73ffe714 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.413346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:39.446408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:39.499420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec05c4c-5e74-483b-b25e-96ae73ffe714 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.501248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344a67-b8d6-4109-a3e3-1d32d5cf91de None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.535997 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2e18-3228-4c75-a7ef-20ad95cd3b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.536619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2e18-3228-4c75-a7ef-20ad95cd3b9e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.536903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2e18-3228-4c75-a7ef-20ad95cd3b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.537179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac2e18-3228-4c75-a7ef-20ad95cd3b9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.538690 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.539339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.539615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.539892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.540621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442, user.id=0392bf2120f944138760768dc5793e34) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:39.540924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.543252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.549968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 103/202] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/role_assignments?user.id=0392bf2120f944138760768dc5793e34&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=0f99070a6a88400199520fccd98977b6 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:39.550756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.634704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2e18-3228-4c75-a7ef-20ad95cd3b9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.637050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac2e18-3228-4c75-a7ef-20ad95cd3b9e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.675969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00c694-d493-4a74-aea0-5fddf00b63de None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.677145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:39.700565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:39.721973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993e183-1118-4471-a1c1-06d3a2426881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.723254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e183-1118-4471-a1c1-06d3a2426881 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.723704 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e183-1118-4471-a1c1-06d3a2426881 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.724476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e183-1118-4471-a1c1-06d3a2426881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.783476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 100/203] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:39.789455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2e18-3228-4c75-a7ef-20ad95cd3b9e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.820847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993e183-1118-4471-a1c1-06d3a2426881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.822682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993e183-1118-4471-a1c1-06d3a2426881 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.907018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac2e18-3228-4c75-a7ef-20ad95cd3b9e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:39.945836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 104/204] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:39.953849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993e183-1118-4471-a1c1-06d3a2426881 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:39.957053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:39.976082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260a147-1186-4918-a63e-4c555690a203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:39.977395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260a147-1186-4918-a63e-4c555690a203 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:39.977890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260a147-1186-4918-a63e-4c555690a203 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:39.978086 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:39.978495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260a147-1186-4918-a63e-4c555690a203 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:39.983433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260a147-1186-4918-a63e-4c555690a203 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:39.985380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260a147-1186-4918-a63e-4c555690a203 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:39.988949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 101/205] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:39.998222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260a147-1186-4918-a63e-4c555690a203 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:40.123187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993e183-1118-4471-a1c1-06d3a2426881 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:40.160373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260a147-1186-4918-a63e-4c555690a203 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:40.197708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f717671-8563-4531-a0c1-ff728d69e262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:40.198896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f717671-8563-4531-a0c1-ff728d69e262 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:40.199201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f717671-8563-4531-a0c1-ff728d69e262 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:40.199480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f717671-8563-4531-a0c1-ff728d69e262 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:40.201405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f717671-8563-4531-a0c1-ff728d69e262 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:40.203142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f717671-8563-4531-a0c1-ff728d69e262 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:40.204869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 105/206] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:40.210940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f717671-8563-4531-a0c1-ff728d69e262 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:40.232659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3406095-022f-4c4a-a8d9-13eb7c168ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:40.233464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406095-022f-4c4a-a8d9-13eb7c168ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:40.233839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406095-022f-4c4a-a8d9-13eb7c168ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:40.234219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3406095-022f-4c4a-a8d9-13eb7c168ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:40.235059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3406095-022f-4c4a-a8d9-13eb7c168ea6 None admin] RBAC: Adding query filter params (role.id=00e163951e5f442fba065051ae50ed7d, scope.project.id=8364b69580ec486c8b430bf6e13ce028, user.id=e526ce62b1b94972a879f678eebed6cb) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:40.235473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3406095-022f-4c4a-a8d9-13eb7c168ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:40.237090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3406095-022f-4c4a-a8d9-13eb7c168ea6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:40.259028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 102/207] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:39 2022] GET /identity/v3/role_assignments?user.id=e526ce62b1b94972a879f678eebed6cb&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=00e163951e5f442fba065051ae50ed7d => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:40.348286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:40.361703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f717671-8563-4531-a0c1-ff728d69e262 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:40.401217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd5bbd-8a18-4189-bf7d-246c781730a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:40.402858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5bbd-8a18-4189-bf7d-246c781730a2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:40.403308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5bbd-8a18-4189-bf7d-246c781730a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:40.403730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5bbd-8a18-4189-bf7d-246c781730a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:40.404624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd5bbd-8a18-4189-bf7d-246c781730a2 None admin] RBAC: Adding query filter params (role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442, user.id=0392bf2120f944138760768dc5793e34) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:40.405116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd5bbd-8a18-4189-bf7d-246c781730a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:40.406753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd5bbd-8a18-4189-bf7d-246c781730a2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:40.413454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 106/208] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:40 2022] GET /identity/v3/role_assignments?user.id=0392bf2120f944138760768dc5793e34&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=377207058e944d2a91e7afd0f3c46025 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:41.908061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c375d52-9539-4195-b606-fe5ff3dc9f61 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:41.908573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c375d52-9539-4195-b606-fe5ff3dc9f61 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:41.908647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c375d52-9539-4195-b606-fe5ff3dc9f61 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:41.909968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 103/209] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:41.915176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c0d0-6be6-4f6e-9c1d-5efa65aaab81 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:41.915623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c0d0-6be6-4f6e-9c1d-5efa65aaab81 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:41.915821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c0d0-6be6-4f6e-9c1d-5efa65aaab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:41.934447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d9a6c0d0-6be6-4f6e-9c1d-5efa65aaab81 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:41.935675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d9a6c0d0-6be6-4f6e-9c1d-5efa65aaab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:41.940731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a4ada-45be-4179-a230-01fc03eb94cf None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:41.941019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a4ada-45be-4179-a230-01fc03eb94cf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:41.941297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a4ada-45be-4179-a230-01fc03eb94cf None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:41.942808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 104/210] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:41.949427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a128d-5f79-42ba-9d90-a369088ac59a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:41.950419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a128d-5f79-42ba-9d90-a369088ac59a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:41.950919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a128d-5f79-42ba-9d90-a369088ac59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:41.974803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e10a128d-5f79-42ba-9d90-a369088ac59a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:41.976830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e10a128d-5f79-42ba-9d90-a369088ac59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:42.018273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 107/211] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:42.051356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:42.071093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 105/212] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:42.115030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241604d-0830-485d-ba49-557ca228c425 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.115337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241604d-0830-485d-ba49-557ca228c425 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.115618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241604d-0830-485d-ba49-557ca228c425 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.117246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 108/213] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:42.122844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676291-103b-45f9-9c14-8e30085d7c86 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.123356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676291-103b-45f9-9c14-8e30085d7c86 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.123803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99676291-103b-45f9-9c14-8e30085d7c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.142080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-99676291-103b-45f9-9c14-8e30085d7c86 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:42.143509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-99676291-103b-45f9-9c14-8e30085d7c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:42.217489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 106/214] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:42.298058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241604d-0830-485d-ba49-557ca228c425 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:42.351121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99676291-103b-45f9-9c14-8e30085d7c86 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:42.392290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:42.413465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241604d-0830-485d-ba49-557ca228c425 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:42.455258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7ae16-3d8c-42c6-bd5d-ab5da1935b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:42.455906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7ae16-3d8c-42c6-bd5d-ab5da1935b4a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.456188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7ae16-3d8c-42c6-bd5d-ab5da1935b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.456462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7ae16-3d8c-42c6-bd5d-ab5da1935b4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.468362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7ae16-3d8c-42c6-bd5d-ab5da1935b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e9e7ae16-3d8c-42c6-bd5d-ab5da1935b4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:42.473707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:42.474591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:42.475403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:42.479310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 109/215] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:42.479824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99676291-103b-45f9-9c14-8e30085d7c86 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:42.481186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7ae16-3d8c-42c6-bd5d-ab5da1935b4a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:42.506075 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:42.523270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858d61-767f-4f2c-acc2-e360b5a2977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:42.524280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858d61-767f-4f2c-acc2-e360b5a2977f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.524736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858d61-767f-4f2c-acc2-e360b5a2977f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.525306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc858d61-767f-4f2c-acc2-e360b5a2977f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.539697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc858d61-767f-4f2c-acc2-e360b5a2977f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-cc858d61-767f-4f2c-acc2-e360b5a2977f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:42.545557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:42.546684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:42.547542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 107/216] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:04:42.548218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858d61-767f-4f2c-acc2-e360b5a2977f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:42.594418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7ae16-3d8c-42c6-bd5d-ab5da1935b4a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:42.629017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:42.629631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.629913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.630192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.630864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:42.631204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:42.632592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:42.640945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 110/217] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:42.640945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:42.645907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:42.662350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc858d61-767f-4f2c-acc2-e360b5a2977f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:42.697353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f59bb1-cdc0-42b9-97ed-314b7d6234a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:42.697981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59bb1-cdc0-42b9-97ed-314b7d6234a7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.698256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59bb1-cdc0-42b9-97ed-314b7d6234a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.698542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59bb1-cdc0-42b9-97ed-314b7d6234a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.699745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f59bb1-cdc0-42b9-97ed-314b7d6234a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:42.701188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f59bb1-cdc0-42b9-97ed-314b7d6234a7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:42.702751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 108/218] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:42.707560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d111be-e4e6-4838-862d-9a7b48f891b6 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.707560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d111be-e4e6-4838-862d-9a7b48f891b6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.707560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d111be-e4e6-4838-862d-9a7b48f891b6 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.707560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 109/219] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:42.707946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d111be-e4e6-4838-862d-9a7b48f891b6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:42.744196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45da5a6-f22b-4bf9-bcb4-a1a2483859fa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:42.760046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:42.778824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:42.779477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.779755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.780034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.780709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:42.781013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:42.782393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:42.790430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 111/220] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:42.791221 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:42.812378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d111be-e4e6-4838-862d-9a7b48f891b6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:42.846312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baaf8b-5e9b-4784-932b-113e8b9980c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:42.846944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baaf8b-5e9b-4784-932b-113e8b9980c0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.847259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baaf8b-5e9b-4784-932b-113e8b9980c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.847543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baaf8b-5e9b-4784-932b-113e8b9980c0 None admin] PATH_INFO: `/v3/users/0392bf2120f944138760768dc5793e34` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.848669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baaf8b-5e9b-4784-932b-113e8b9980c0 None admin] RBAC: Authorizing `identity:get_user(user_id=0392bf2120f944138760768dc5793e34)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:42.850099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95baaf8b-5e9b-4784-932b-113e8b9980c0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:42.851971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 110/221] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:42 2022] GET /identity/v3/users/0392bf2120f944138760768dc5793e34 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:42.854161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bce32-493d-4ddb-9201-8e25e5647565 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.854494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bce32-493d-4ddb-9201-8e25e5647565 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.854775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bce32-493d-4ddb-9201-8e25e5647565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.855968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:42.873090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ac5bce32-493d-4ddb-9201-8e25e5647565 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:42.874280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ac5bce32-493d-4ddb-9201-8e25e5647565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:42.893275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970b061-0919-4adb-96f5-7539deaa31f0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:42.926426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae229-edf4-4b2b-a2d4-cb7ac30a68d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:42.927048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae229-edf4-4b2b-a2d4-cb7ac30a68d7 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:42.927344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae229-edf4-4b2b-a2d4-cb7ac30a68d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:42.927624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eae229-edf4-4b2b-a2d4-cb7ac30a68d7 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:42.928270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae229-edf4-4b2b-a2d4-cb7ac30a68d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:42.929703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eae229-edf4-4b2b-a2d4-cb7ac30a68d7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:42.941185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 111/222] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:42.947914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bce32-493d-4ddb-9201-8e25e5647565 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:42.959098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 112/223] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:04:42 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:42.959098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae229-edf4-4b2b-a2d4-cb7ac30a68d7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:43.004282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:43.062577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bce32-493d-4ddb-9201-8e25e5647565 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:43.106046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eae229-edf4-4b2b-a2d4-cb7ac30a68d7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:43.106409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4d58-d54f-477e-8781-6fe467dd9f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:43.107106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4d58-d54f-477e-8781-6fe467dd9f8c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:43.107508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4d58-d54f-477e-8781-6fe467dd9f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:43.107790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c4d58-d54f-477e-8781-6fe467dd9f8c None admin] PATH_INFO: `/v3/users/03bc2371c2cb4b07b6044bd3053e73b2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:43.123653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c4d58-d54f-477e-8781-6fe467dd9f8c None admin] RBAC: Authorizing `identity:get_user(user_id=03bc2371c2cb4b07b6044bd3053e73b2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:43.125156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c4d58-d54f-477e-8781-6fe467dd9f8c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:43.127162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 112/224] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:42 2022] GET /identity/v3/users/03bc2371c2cb4b07b6044bd3053e73b2 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:43.133527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4d58-d54f-477e-8781-6fe467dd9f8c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:43.133988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:43.154688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930e39-91e0-4ba1-a99f-bcf5a6468c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:43.155502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930e39-91e0-4ba1-a99f-bcf5a6468c0f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:43.155877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930e39-91e0-4ba1-a99f-bcf5a6468c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:43.156220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930e39-91e0-4ba1-a99f-bcf5a6468c0f None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:43.157933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd930e39-91e0-4ba1-a99f-bcf5a6468c0f None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:43.159551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd930e39-91e0-4ba1-a99f-bcf5a6468c0f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:43.161361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 113/225] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:42 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:43.168017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930e39-91e0-4ba1-a99f-bcf5a6468c0f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:43.257190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c4d58-d54f-477e-8781-6fe467dd9f8c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:43.266756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:43.291064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930e39-91e0-4ba1-a99f-bcf5a6468c0f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:43.302098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895ce9-aa65-48cc-b911-cf223bafdcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:43.303631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895ce9-aa65-48cc-b911-cf223bafdcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:43.304249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895ce9-aa65-48cc-b911-cf223bafdcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:43.304538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895ce9-aa65-48cc-b911-cf223bafdcb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:43.331321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a0497-7d6b-4279-ab06-742611b1e7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:43.332046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0497-7d6b-4279-ab06-742611b1e7e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:43.332632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0497-7d6b-4279-ab06-742611b1e7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:43.332632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a0497-7d6b-4279-ab06-742611b1e7e4 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/users/0392bf2120f944138760768dc5793e34/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:43.334523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a0497-7d6b-4279-ab06-742611b1e7e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=77531e28ab5e4a9f970bf1dea34d9442, user_id=0392bf2120f944138760768dc5793e34, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:43.336902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a0497-7d6b-4279-ab06-742611b1e7e4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:43.353721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 114/226] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:43 2022] PUT /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/users/0392bf2120f944138760768dc5793e34/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:43.355450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a0497-7d6b-4279-ab06-742611b1e7e4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:43.412565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895ce9-aa65-48cc-b911-cf223bafdcb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:43.414269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895ce9-aa65-48cc-b911-cf223bafdcb9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:43.441895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:43.509435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a0497-7d6b-4279-ab06-742611b1e7e4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:43.552254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abd8c8-fbf3-41da-9840-af24ecf2e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:43.552918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abd8c8-fbf3-41da-9840-af24ecf2e595 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:43.553204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abd8c8-fbf3-41da-9840-af24ecf2e595 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:43.553484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abd8c8-fbf3-41da-9840-af24ecf2e595 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:43.567114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abd8c8-fbf3-41da-9840-af24ecf2e595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-98abd8c8-fbf3-41da-9840-af24ecf2e595 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:43.575268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:43.576146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:43.576905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:43.577945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 115/227] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:04:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:43.583473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abd8c8-fbf3-41da-9840-af24ecf2e595 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:43.629503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 113/228] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:04:43.636101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895ce9-aa65-48cc-b911-cf223bafdcb9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:43.645085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:43.721594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abd8c8-fbf3-41da-9840-af24ecf2e595 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:43.735867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:43.754542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895ce9-aa65-48cc-b911-cf223bafdcb9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:43.767676 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:43.768513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:43.768801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:43.769081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:43.770006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:43.770319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:43.772542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:43.784901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 116/229] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:04:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:43.793875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:43.796252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a246b-c42d-4849-ab66-b7a62971681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:43.796901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a246b-c42d-4849-ab66-b7a62971681c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:43.797294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a246b-c42d-4849-ab66-b7a62971681c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:43.797581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a246b-c42d-4849-ab66-b7a62971681c None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:43.798868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a246b-c42d-4849-ab66-b7a62971681c None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:43.800436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a246b-c42d-4849-ab66-b7a62971681c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:43.802539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 114/230] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:43 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:43.808971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a246b-c42d-4849-ab66-b7a62971681c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:43.892343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:43.921409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a246b-c42d-4849-ab66-b7a62971681c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:43.960611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:43.961260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:43.961607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:43.961898 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:43.962643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] RBAC: Adding query filter params (role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442, user.id=03bc2371c2cb4b07b6044bd3053e73b2) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:43.962963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:43.964872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:43.970768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 115/231] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:43 2022] GET /identity/v3/role_assignments?user.id=03bc2371c2cb4b07b6044bd3053e73b2&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:43.999594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a24ce-ac9a-4ae6-b6cd-7ae842ec3559 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:44.060677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06117b62-24ae-42c7-aabe-f213acf176b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:44.061699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117b62-24ae-42c7-aabe-f213acf176b8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:44.062233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117b62-24ae-42c7-aabe-f213acf176b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:44.062717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06117b62-24ae-42c7-aabe-f213acf176b8 None admin] PATH_INFO: `/v3/users/0392bf2120f944138760768dc5793e34` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:44.067920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06117b62-24ae-42c7-aabe-f213acf176b8 None admin] RBAC: Authorizing `identity:get_user(user_id=0392bf2120f944138760768dc5793e34)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:44.069766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06117b62-24ae-42c7-aabe-f213acf176b8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:44.071803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 117/232] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:43 2022] GET /identity/v3/users/0392bf2120f944138760768dc5793e34 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:44.078201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:44.234189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed324e72-c7b9-4943-96c3-c71385983693 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:44.270889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f8805-be25-4716-a8fe-081921830098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:44.271568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8805-be25-4716-a8fe-081921830098 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:44.271860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8805-be25-4716-a8fe-081921830098 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:44.272140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f8805-be25-4716-a8fe-081921830098 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:44.273336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f8805-be25-4716-a8fe-081921830098 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:44.274785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f8805-be25-4716-a8fe-081921830098 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:44.276963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 116/233] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:44 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:44.288064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06117b62-24ae-42c7-aabe-f213acf176b8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:44.357200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:44.438032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06117b62-24ae-42c7-aabe-f213acf176b8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:44.491772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201852c-2ab2-4eb3-bac8-a926b62ee25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:44.492725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201852c-2ab2-4eb3-bac8-a926b62ee25f None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:44.493011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201852c-2ab2-4eb3-bac8-a926b62ee25f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:44.493286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201852c-2ab2-4eb3-bac8-a926b62ee25f None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/users/0392bf2120f944138760768dc5793e34/roles/377207058e944d2a91e7afd0f3c46025` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:44.500765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201852c-2ab2-4eb3-bac8-a926b62ee25f None admin] RBAC: Authorizing `identity:create_grant(project_id=77531e28ab5e4a9f970bf1dea34d9442, user_id=0392bf2120f944138760768dc5793e34, role_id=377207058e944d2a91e7afd0f3c46025)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:44.502241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201852c-2ab2-4eb3-bac8-a926b62ee25f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:44.533173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 118/234] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:44 2022] PUT /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/users/0392bf2120f944138760768dc5793e34/roles/377207058e944d2a91e7afd0f3c46025 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:45.808373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580061f-200d-4a76-b92c-754171e95c5b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:45.808888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580061f-200d-4a76-b92c-754171e95c5b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:45.808965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580061f-200d-4a76-b92c-754171e95c5b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:45.810583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 117/235] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:45.815900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2bb3-e601-4abf-ab3d-4889af5b80e0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:45.816717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2bb3-e601-4abf-ab3d-4889af5b80e0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:45.817211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2bb3-e601-4abf-ab3d-4889af5b80e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:45.844037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-12ac2bb3-e601-4abf-ab3d-4889af5b80e0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:45.845588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-12ac2bb3-e601-4abf-ab3d-4889af5b80e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:45.937782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 119/236] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:46.069684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3b76-519d-41e3-a752-a3d908900de0 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.069975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3b76-519d-41e3-a752-a3d908900de0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.070169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3b76-519d-41e3-a752-a3d908900de0 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.071611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 118/237] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:46.077267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b03b0-709d-4ea1-8eb7-54293e21f55b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.077559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b03b0-709d-4ea1-8eb7-54293e21f55b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.077832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b03b0-709d-4ea1-8eb7-54293e21f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.081217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b8a12-5311-4937-85a3-3179c60b2188 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.081501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b8a12-5311-4937-85a3-3179c60b2188 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.081779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b8a12-5311-4937-85a3-3179c60b2188 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.083312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 119/238] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:46.087718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173ea7-8d18-4f4b-8aea-d2eba93eaa23 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.087999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173ea7-8d18-4f4b-8aea-d2eba93eaa23 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.088274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173ea7-8d18-4f4b-8aea-d2eba93eaa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.109073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:46.118871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-552b03b0-709d-4ea1-8eb7-54293e21f55b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:46.120778 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-552b03b0-709d-4ea1-8eb7-54293e21f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:46.123626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e6173ea7-8d18-4f4b-8aea-d2eba93eaa23 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:46.124776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e6173ea7-8d18-4f4b-8aea-d2eba93eaa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:46.167545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:46.249155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 120/239] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:46.249369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 120/240] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:46.339672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173ea7-8d18-4f4b-8aea-d2eba93eaa23 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:46.473557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6173ea7-8d18-4f4b-8aea-d2eba93eaa23 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:46.512476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a746a-ad92-46aa-bac6-e70918202099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:46.513126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a746a-ad92-46aa-bac6-e70918202099 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.513403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a746a-ad92-46aa-bac6-e70918202099 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.513676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a746a-ad92-46aa-bac6-e70918202099 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.516456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:46.524817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a746a-ad92-46aa-bac6-e70918202099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-459a746a-ad92-46aa-bac6-e70918202099 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:46.530017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:46.530925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:46.531747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 121/241] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:46.537121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b03b0-709d-4ea1-8eb7-54293e21f55b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:46.568967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a746a-ad92-46aa-bac6-e70918202099 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:46.685499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b03b0-709d-4ea1-8eb7-54293e21f55b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:46.687702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a746a-ad92-46aa-bac6-e70918202099 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:46.727618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4fb1b-f709-498f-ba0e-b2a95ccff200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:46.727821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef347c9-e161-4687-a153-46443db32155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:46.728237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef347c9-e161-4687-a153-46443db32155 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.728358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4fb1b-f709-498f-ba0e-b2a95ccff200 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.728512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef347c9-e161-4687-a153-46443db32155 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.728601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4fb1b-f709-498f-ba0e-b2a95ccff200 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.728787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4fb1b-f709-498f-ba0e-b2a95ccff200 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.728876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef347c9-e161-4687-a153-46443db32155 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.729713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef347c9-e161-4687-a153-46443db32155 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:46.730027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef347c9-e161-4687-a153-46443db32155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:46.730118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4fb1b-f709-498f-ba0e-b2a95ccff200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:46.731437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef347c9-e161-4687-a153-46443db32155 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:46.731530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4fb1b-f709-498f-ba0e-b2a95ccff200 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:46.737730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 122/242] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:46.737730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc65a-22ea-4e25-922d-c58a3b388378 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.737730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc65a-22ea-4e25-922d-c58a3b388378 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.737730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fc65a-22ea-4e25-922d-c58a3b388378 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.739223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 123/243] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:46.739883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fc65a-22ea-4e25-922d-c58a3b388378 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:46.745308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 121/244] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:46.746406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef347c9-e161-4687-a153-46443db32155 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:46.780313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:46.812320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:46.855998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fc65a-22ea-4e25-922d-c58a3b388378 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:46.864289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef347c9-e161-4687-a153-46443db32155 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:46.894616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447955a-6cd3-4548-87e8-7ea430cd3f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:46.895735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447955a-6cd3-4548-87e8-7ea430cd3f25 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.896259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447955a-6cd3-4548-87e8-7ea430cd3f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.896768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447955a-6cd3-4548-87e8-7ea430cd3f25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.898435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7107-48d8-411d-9032-706ac358337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:46.899068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7107-48d8-411d-9032-706ac358337c None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.899357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7107-48d8-411d-9032-706ac358337c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.899635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7107-48d8-411d-9032-706ac358337c None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.900357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d7107-48d8-411d-9032-706ac358337c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:46.902403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d7107-48d8-411d-9032-706ac358337c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:46.909501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447955a-6cd3-4548-87e8-7ea430cd3f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d447955a-6cd3-4548-87e8-7ea430cd3f25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:46.916485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:46.917506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:04:46.918271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:46.923164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 124/245] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:04:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:46.924710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29890-6d2b-4e40-93e4-ec3c55223226 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:46.925078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29890-6d2b-4e40-93e4-ec3c55223226 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:46.925366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29890-6d2b-4e40-93e4-ec3c55223226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:46.928451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 122/246] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:04:46 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:46.940161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7107-48d8-411d-9032-706ac358337c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:46.945452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ecc29890-6d2b-4e40-93e4-ec3c55223226 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:46.946976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ecc29890-6d2b-4e40-93e4-ec3c55223226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:47.037940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 125/247] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:47.045190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29890-6d2b-4e40-93e4-ec3c55223226 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:47.077833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:47.124027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7107-48d8-411d-9032-706ac358337c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:47.155646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:47.165788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44568287-4404-4917-9c1e-e60fc2fe023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:47.166434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568287-4404-4917-9c1e-e60fc2fe023e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:47.167422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568287-4404-4917-9c1e-e60fc2fe023e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:47.167852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44568287-4404-4917-9c1e-e60fc2fe023e None admin] PATH_INFO: `/v3/users/6deab9883b494ae69769695cd6b37b8d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:47.199681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44568287-4404-4917-9c1e-e60fc2fe023e None admin] RBAC: Authorizing `identity:get_user(user_id=6deab9883b494ae69769695cd6b37b8d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:47.201190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44568287-4404-4917-9c1e-e60fc2fe023e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:47.203221 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 123/248] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:46 2022] GET /identity/v3/users/6deab9883b494ae69769695cd6b37b8d => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:47.208607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44568287-4404-4917-9c1e-e60fc2fe023e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:47.213180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29890-6d2b-4e40-93e4-ec3c55223226 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:47.257883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe90798-a586-49e5-a089-604d9bf490ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:47.258617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90798-a586-49e5-a089-604d9bf490ae None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:47.258950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90798-a586-49e5-a089-604d9bf490ae None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:47.259335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe90798-a586-49e5-a089-604d9bf490ae None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:47.261240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe90798-a586-49e5-a089-604d9bf490ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:47.261240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe90798-a586-49e5-a089-604d9bf490ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:47.262330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe90798-a586-49e5-a089-604d9bf490ae None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:47.272948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 126/249] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:47.274297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b2f7-b348-4714-833b-b47e1f4be098 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:47.274660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b2f7-b348-4714-833b-b47e1f4be098 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:47.275491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63b2f7-b348-4714-833b-b47e1f4be098 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:47.278178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 127/250] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:47.280061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63b2f7-b348-4714-833b-b47e1f4be098 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:47.342895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44568287-4404-4917-9c1e-e60fc2fe023e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:47.383697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a27bae-6f23-49be-a7d4-fe8ef46b36b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:47.384317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27bae-6f23-49be-a7d4-fe8ef46b36b2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:47.384637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27bae-6f23-49be-a7d4-fe8ef46b36b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:47.384883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a27bae-6f23-49be-a7d4-fe8ef46b36b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:47.389442 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:47.415958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63b2f7-b348-4714-833b-b47e1f4be098 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:47.434926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:47.467102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191fb0c-af8d-451e-b6cd-3dd2fbf4c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:47.467615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191fb0c-af8d-451e-b6cd-3dd2fbf4c93c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:47.467900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191fb0c-af8d-451e-b6cd-3dd2fbf4c93c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:47.468181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191fb0c-af8d-451e-b6cd-3dd2fbf4c93c None admin] PATH_INFO: `/v3/users/0392bf2120f944138760768dc5793e34` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:47.469329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191fb0c-af8d-451e-b6cd-3dd2fbf4c93c None admin] RBAC: Authorizing `identity:get_user(user_id=0392bf2120f944138760768dc5793e34)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:47.471097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191fb0c-af8d-451e-b6cd-3dd2fbf4c93c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:47.472723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 128/251] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:47 2022] GET /identity/v3/users/0392bf2120f944138760768dc5793e34 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:47.473245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a27bae-6f23-49be-a7d4-fe8ef46b36b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:47.473877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdf8d-b7bd-4e30-83cc-c912ff4c09df None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:47.474159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdf8d-b7bd-4e30-83cc-c912ff4c09df None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:47.474434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fdf8d-b7bd-4e30-83cc-c912ff4c09df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:47.474782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a27bae-6f23-49be-a7d4-fe8ef46b36b2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:47.494563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ac9fdf8d-b7bd-4e30-83cc-c912ff4c09df None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:47.496089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ac9fdf8d-b7bd-4e30-83cc-c912ff4c09df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:47.570257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 129/252] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:47.571156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fdf8d-b7bd-4e30-83cc-c912ff4c09df None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:47.608864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 124/253] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:04:47.610040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a27bae-6f23-49be-a7d4-fe8ef46b36b2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:47.665641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:47.761010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fdf8d-b7bd-4e30-83cc-c912ff4c09df None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:47.791343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:47.797310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a27bae-6f23-49be-a7d4-fe8ef46b36b2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:47.824740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d9804-bd80-43dd-98ff-4e6ed4e6b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:47.825389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d9804-bd80-43dd-98ff-4e6ed4e6b792 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:47.825673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d9804-bd80-43dd-98ff-4e6ed4e6b792 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:47.825951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d9804-bd80-43dd-98ff-4e6ed4e6b792 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:47.847578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d9804-bd80-43dd-98ff-4e6ed4e6b792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:47.852045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00126f7d-67a8-4b91-9102-e3bdbba69d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:47.852873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126f7d-67a8-4b91-9102-e3bdbba69d20 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-bd1d9804-bd80-43dd-98ff-4e6ed4e6b792 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:47.852987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:47.854047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 130/254] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:47.855436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d9804-bd80-43dd-98ff-4e6ed4e6b792 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:47.856695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126f7d-67a8-4b91-9102-e3bdbba69d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:47.857115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00126f7d-67a8-4b91-9102-e3bdbba69d20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:47.953715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00126f7d-67a8-4b91-9102-e3bdbba69d20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:47.955370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00126f7d-67a8-4b91-9102-e3bdbba69d20 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:47.981368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d9804-bd80-43dd-98ff-4e6ed4e6b792 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:47.992126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:48.018636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf881c2-4319-4799-93b2-a6a259dfb323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.019588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf881c2-4319-4799-93b2-a6a259dfb323 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.020036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf881c2-4319-4799-93b2-a6a259dfb323 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.020455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf881c2-4319-4799-93b2-a6a259dfb323 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.021743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf881c2-4319-4799-93b2-a6a259dfb323 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:48.023368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf881c2-4319-4799-93b2-a6a259dfb323 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:48.030514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 131/255] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:47 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:48.031661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf881c2-4319-4799-93b2-a6a259dfb323 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.079567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:48.083447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 125/256] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:48.087746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00126f7d-67a8-4b91-9102-e3bdbba69d20 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.169747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf881c2-4319-4799-93b2-a6a259dfb323 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:48.203664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00126f7d-67a8-4b91-9102-e3bdbba69d20 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:48.216540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.217165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.217448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.217728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.218404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:48.218957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:48.220938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:48.233130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 132/257] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:48.234005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.248781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962a0b7-8eb8-44a9-a474-68c87f9d7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.249673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962a0b7-8eb8-44a9-a474-68c87f9d7635 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.249673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962a0b7-8eb8-44a9-a474-68c87f9d7635 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.249966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962a0b7-8eb8-44a9-a474-68c87f9d7635 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.253423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:48.263987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962a0b7-8eb8-44a9-a474-68c87f9d7635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-8962a0b7-8eb8-44a9-a474-68c87f9d7635 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:48.269130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:48.269963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:48.270753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 126/258] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:48.271458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962a0b7-8eb8-44a9-a474-68c87f9d7635 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.363761 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ae53-3a0e-4e53-a7d6-7c2d3eb4e841 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:48.366779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:48.402763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e0061-7551-42d7-a743-053b656b884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.403423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0061-7551-42d7-a743-053b656b884e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.403707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0061-7551-42d7-a743-053b656b884e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.404056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e0061-7551-42d7-a743-053b656b884e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.404713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e0061-7551-42d7-a743-053b656b884e None admin] RBAC: Adding query filter params (role.id=00e163951e5f442fba065051ae50ed7d, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442, user.id=6deab9883b494ae69769695cd6b37b8d) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:48.405027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e0061-7551-42d7-a743-053b656b884e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:48.406522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e0061-7551-42d7-a743-053b656b884e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:48.410104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962a0b7-8eb8-44a9-a474-68c87f9d7635 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:48.412338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 133/259] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/role_assignments?user.id=6deab9883b494ae69769695cd6b37b8d&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=00e163951e5f442fba065051ae50ed7d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:48.412951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e0061-7551-42d7-a743-053b656b884e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.454688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e9a5b-95d3-4166-808f-64ace44deb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.455371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e9a5b-95d3-4166-808f-64ace44deb3f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.455650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e9a5b-95d3-4166-808f-64ace44deb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.455925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e9a5b-95d3-4166-808f-64ace44deb3f None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.457272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e9a5b-95d3-4166-808f-64ace44deb3f None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:48.458772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e9a5b-95d3-4166-808f-64ace44deb3f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:48.472875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 127/260] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:48.473841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e9a5b-95d3-4166-808f-64ace44deb3f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.568409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:48.613688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e9a5b-95d3-4166-808f-64ace44deb3f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:48.616533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e0061-7551-42d7-a743-053b656b884e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:48.659949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.660592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.660875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.661152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.663414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55141f64-446f-4a38-b351-79b306f90f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.664062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141f64-446f-4a38-b351-79b306f90f96 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.664336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141f64-446f-4a38-b351-79b306f90f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.664609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55141f64-446f-4a38-b351-79b306f90f96 None admin] PATH_INFO: `/v3/users/03bc2371c2cb4b07b6044bd3053e73b2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.665282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:48.665624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:48.667121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:48.668525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55141f64-446f-4a38-b351-79b306f90f96 None admin] RBAC: Authorizing `identity:get_user(user_id=03bc2371c2cb4b07b6044bd3053e73b2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:48.669980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55141f64-446f-4a38-b351-79b306f90f96 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:48.677310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 134/261] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/users/03bc2371c2cb4b07b6044bd3053e73b2 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:48.678207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55141f64-446f-4a38-b351-79b306f90f96 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.686584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 128/262] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:48.687499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.752871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:48.833526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64325c24-e536-4d98-a83d-373c30f5e5a4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:48.860411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:48.870653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6719a0-e989-4e2f-821d-878e80621b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.871564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6719a0-e989-4e2f-821d-878e80621b54 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.871857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6719a0-e989-4e2f-821d-878e80621b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.872129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6719a0-e989-4e2f-821d-878e80621b54 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.873270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6719a0-e989-4e2f-821d-878e80621b54 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:48.880322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6719a0-e989-4e2f-821d-878e80621b54 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:48.882190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 129/263] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:48.882741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6719a0-e989-4e2f-821d-878e80621b54 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:48.889078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55141f64-446f-4a38-b351-79b306f90f96 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:48.944273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:48.944900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:48.945181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:48.945456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:48.946195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442, user.id=0392bf2120f944138760768dc5793e34) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:48.946508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:48.948064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:48.964734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 135/264] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/role_assignments?user.id=0392bf2120f944138760768dc5793e34&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=0f99070a6a88400199520fccd98977b6 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:48.965553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:49.030089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6719a0-e989-4e2f-821d-878e80621b54 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:49.116536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0462a94-4ec0-4729-9f12-7b831a98e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:49.117536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0462a94-4ec0-4729-9f12-7b831a98e620 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.118665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0462a94-4ec0-4729-9f12-7b831a98e620 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.119204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0462a94-4ec0-4729-9f12-7b831a98e620 None admin] PATH_INFO: `/v3/users/0392bf2120f944138760768dc5793e34` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.123958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0462a94-4ec0-4729-9f12-7b831a98e620 None admin] RBAC: Authorizing `identity:get_user(user_id=0392bf2120f944138760768dc5793e34)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:49.125979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0462a94-4ec0-4729-9f12-7b831a98e620 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:49.128460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 130/265] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:48 2022] GET /identity/v3/users/0392bf2120f944138760768dc5793e34 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:49.134840 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0462a94-4ec0-4729-9f12-7b831a98e620 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:49.242537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:49.281577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0462a94-4ec0-4729-9f12-7b831a98e620 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:49.288201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:49.295235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa841719-5e85-45ce-bd2f-fcb7ba92f345 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:49.321010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06268d0-4219-49fc-9865-c5100afbf423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:49.321626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06268d0-4219-49fc-9865-c5100afbf423 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.321933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06268d0-4219-49fc-9865-c5100afbf423 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.322187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06268d0-4219-49fc-9865-c5100afbf423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.398540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06268d0-4219-49fc-9865-c5100afbf423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:49.400836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06268d0-4219-49fc-9865-c5100afbf423 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:49.447019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3c818-cdd9-4dd7-a44f-baf544cd88d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:49.447019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c818-cdd9-4dd7-a44f-baf544cd88d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.447019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c818-cdd9-4dd7-a44f-baf544cd88d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.447019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3c818-cdd9-4dd7-a44f-baf544cd88d8 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/users/03bc2371c2cb4b07b6044bd3053e73b2/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.448882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3c818-cdd9-4dd7-a44f-baf544cd88d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=77531e28ab5e4a9f970bf1dea34d9442, user_id=03bc2371c2cb4b07b6044bd3053e73b2, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:49.450347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3c818-cdd9-4dd7-a44f-baf544cd88d8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:49.483368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:49.498261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 136/266] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:48 2022] PUT /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/users/03bc2371c2cb4b07b6044bd3053e73b2/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:49.523436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 131/267] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:04:49.530386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3c818-cdd9-4dd7-a44f-baf544cd88d8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:49.666371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3c818-cdd9-4dd7-a44f-baf544cd88d8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:49.706862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0908f-4674-416f-a041-7d730c135e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:49.707566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0908f-4674-416f-a041-7d730c135e86 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.707986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0908f-4674-416f-a041-7d730c135e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.708267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0908f-4674-416f-a041-7d730c135e86 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.709438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0908f-4674-416f-a041-7d730c135e86 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:49.710890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0908f-4674-416f-a041-7d730c135e86 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:49.713004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 137/268] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:49 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:49.719002 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06268d0-4219-49fc-9865-c5100afbf423 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:49.760092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41431ac9-8d82-4f2b-b779-7cc5aa650e13 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.761000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41431ac9-8d82-4f2b-b779-7cc5aa650e13 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.761230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41431ac9-8d82-4f2b-b779-7cc5aa650e13 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.763050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 138/269] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:49.774117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fab97-c806-4899-84a6-b51714d0c1d7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.774426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fab97-c806-4899-84a6-b51714d0c1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.774671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fab97-c806-4899-84a6-b51714d0c1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.806733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4b6fab97-c806-4899-84a6-b51714d0c1d7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:49.808721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4b6fab97-c806-4899-84a6-b51714d0c1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:49.840738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:49.891699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06268d0-4219-49fc-9865-c5100afbf423 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:49.898421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 139/270] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:49.900370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0fcbc-a60c-454e-bd4e-be22a025c5b0 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.900887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0fcbc-a60c-454e-bd4e-be22a025c5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.901428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac0fcbc-a60c-454e-bd4e-be22a025c5b0 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.902986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 140/271] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:49.908326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a83d2-e2ad-4724-a0d8-4d7b30443569 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.908863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a83d2-e2ad-4724-a0d8-4d7b30443569 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.909227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a83d2-e2ad-4724-a0d8-4d7b30443569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.928703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-fb5a83d2-e2ad-4724-a0d8-4d7b30443569 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:49.930189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fb5a83d2-e2ad-4724-a0d8-4d7b30443569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:49.932837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:49.933641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:49.934128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:49.934408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:49.936113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] RBAC: Adding query filter params (role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442, user.id=0392bf2120f944138760768dc5793e34) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:49.936432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:49.937882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:49.946036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 132/272] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:49 2022] GET /identity/v3/role_assignments?user.id=0392bf2120f944138760768dc5793e34&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=377207058e944d2a91e7afd0f3c46025 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:50.033470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 141/273] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:50.240755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:50.280346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:50.377989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252ba8f-07cd-4716-a9b0-d68ffcce2b15 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:50.392129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a83d2-e2ad-4724-a0d8-4d7b30443569 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:50.415894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743aea-684a-441b-a850-dc6e187dd568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:50.416891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743aea-684a-441b-a850-dc6e187dd568 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:50.417172 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743aea-684a-441b-a850-dc6e187dd568 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:50.417451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98743aea-684a-441b-a850-dc6e187dd568 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:50.440695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98743aea-684a-441b-a850-dc6e187dd568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-98743aea-684a-441b-a850-dc6e187dd568 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:50.447199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:50.448348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:50.449587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 133/274] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:50.455281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743aea-684a-441b-a850-dc6e187dd568 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:50.517923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:50.535710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a83d2-e2ad-4724-a0d8-4d7b30443569 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:50.581483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:50.582211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2d4ea-5be2-4648-ac79-d43d3c6d392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:50.583143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2d4ea-5be2-4648-ac79-d43d3c6d392c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:50.583621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2d4ea-5be2-4648-ac79-d43d3c6d392c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:50.584103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2d4ea-5be2-4648-ac79-d43d3c6d392c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:50.586031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2d4ea-5be2-4648-ac79-d43d3c6d392c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:50.587934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2d4ea-5be2-4648-ac79-d43d3c6d392c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:50.595555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 142/275] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:50.596537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2d4ea-5be2-4648-ac79-d43d3c6d392c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:50.599198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98743aea-684a-441b-a850-dc6e187dd568 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:50.637210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:50.638157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:50.638661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:50.639181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:50.640065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:50.640570 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:50.642153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:50.652304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 134/276] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:50.657911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:50.725525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2d4ea-5be2-4648-ac79-d43d3c6d392c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:50.770548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e67ee-de0b-45e5-98be-0f1938b88d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:50.771412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e67ee-de0b-45e5-98be-0f1938b88d38 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:50.771858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e67ee-de0b-45e5-98be-0f1938b88d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:50.772437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e67ee-de0b-45e5-98be-0f1938b88d38 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:50.773606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e67ee-de0b-45e5-98be-0f1938b88d38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:50.775681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e67ee-de0b-45e5-98be-0f1938b88d38 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:50.796032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46976be-02d8-40bf-8722-f716cdb7aad5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:50.811365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 143/277] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:04:50 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:50.838152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9137f1-c686-4c7b-a866-494afe750cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:50.838953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9137f1-c686-4c7b-a866-494afe750cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:50.839328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9137f1-c686-4c7b-a866-494afe750cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:50.839637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9137f1-c686-4c7b-a866-494afe750cc3 None admin] PATH_INFO: `/v3/users/b92a1ec2f892458a9a31a8ac0136b6b2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:50.857206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9137f1-c686-4c7b-a866-494afe750cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=b92a1ec2f892458a9a31a8ac0136b6b2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:50.858829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9137f1-c686-4c7b-a866-494afe750cc3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:50.860634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 135/278] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:50 2022] GET /identity/v3/users/b92a1ec2f892458a9a31a8ac0136b6b2 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:50.866758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e67ee-de0b-45e5-98be-0f1938b88d38 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:50.884868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:50.989344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e67ee-de0b-45e5-98be-0f1938b88d38 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:51.026087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:51.026637 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:51.026923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:51.027230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:51.027970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] RBAC: Adding query filter params (role.id=f686c7083ea64f748bfab4a77dd732e2, user.id=b92a1ec2f892458a9a31a8ac0136b6b2, scope.system=all) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:51.028282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:51.030185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:51.030676 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99960e-4c0d-44c5-aae2-3e01cc95775b None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:51.031257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99960e-4c0d-44c5-aae2-3e01cc95775b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:51.031539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99960e-4c0d-44c5-aae2-3e01cc95775b None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:51.033161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 136/279] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:51.037994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 144/280] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 16 19:04:50 2022] GET /identity/v3/role_assignments?user.id=b92a1ec2f892458a9a31a8ac0136b6b2&scope.system=all&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:51.038124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b2be-bdda-48c9-b42b-6b5f2339b5c2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:51.038414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b2be-bdda-48c9-b42b-6b5f2339b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:51.038699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b2be-bdda-48c9-b42b-6b5f2339b5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:51.056097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:51.066401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f341b2be-bdda-48c9-b42b-6b5f2339b5c2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:51.068159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f341b2be-bdda-48c9-b42b-6b5f2339b5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:51.156344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 137/281] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:51.433387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:51.545116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:51.574377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376bb7-34b6-4db8-8c6e-850c3d46eacd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:51.615345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4431-0405-4099-a6e3-0591b16780ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:51.616324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4431-0405-4099-a6e3-0591b16780ea None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:51.616800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4431-0405-4099-a6e3-0591b16780ea None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:51.617295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b4431-0405-4099-a6e3-0591b16780ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:51.640079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b4431-0405-4099-a6e3-0591b16780ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-338b4431-0405-4099-a6e3-0591b16780ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:51.645474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:51.646337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:51.647128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:51.649641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 145/282] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:51.656079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341b2be-bdda-48c9-b42b-6b5f2339b5c2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:51.804693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341b2be-bdda-48c9-b42b-6b5f2339b5c2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:51.853825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:51.854523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:51.854799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:51.855161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:51.855897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:51.856204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:51.857584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:51.860035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:51.870302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 138/283] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:51.876487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4431-0405-4099-a6e3-0591b16780ea None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:52.004492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b4431-0405-4099-a6e3-0591b16780ea None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:52.044274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f6b3a-8c8e-48ae-8be8-102fda0176ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:52.045462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6b3a-8c8e-48ae-8be8-102fda0176ba None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:52.045964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6b3a-8c8e-48ae-8be8-102fda0176ba None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:52.046431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f6b3a-8c8e-48ae-8be8-102fda0176ba None admin] PATH_INFO: `/v3/users/6deab9883b494ae69769695cd6b37b8d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:52.048286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f6b3a-8c8e-48ae-8be8-102fda0176ba None admin] RBAC: Authorizing `identity:get_user(user_id=6deab9883b494ae69769695cd6b37b8d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:52.050287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f6b3a-8c8e-48ae-8be8-102fda0176ba None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:52.052454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 146/284] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:51 2022] GET /identity/v3/users/6deab9883b494ae69769695cd6b37b8d => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:52.059409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:52.172453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc587bde-bd9d-4971-a8a8-28eeb0f549ad None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:52.222399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc042e-b48d-4334-abb4-e4e7cdc109b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:52.223369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc042e-b48d-4334-abb4-e4e7cdc109b5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:52.223820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc042e-b48d-4334-abb4-e4e7cdc109b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:52.224287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc042e-b48d-4334-abb4-e4e7cdc109b5 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:52.225652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc042e-b48d-4334-abb4-e4e7cdc109b5 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:52.227615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc042e-b48d-4334-abb4-e4e7cdc109b5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:52.230690 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 139/285] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:52 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:52.236564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f6b3a-8c8e-48ae-8be8-102fda0176ba None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:52.241168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:52.243160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236a2f-a99d-4b28-b397-eee31cd27762 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:52.243160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236a2f-a99d-4b28-b397-eee31cd27762 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:52.243160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a236a2f-a99d-4b28-b397-eee31cd27762 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:52.244773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 140/286] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:52.251082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858339-4ebb-4617-a2b5-77d7c0e24313 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:52.251082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858339-4ebb-4617-a2b5-77d7c0e24313 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:52.251356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858339-4ebb-4617-a2b5-77d7c0e24313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:52.280552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d3858339-4ebb-4617-a2b5-77d7c0e24313 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:52.281762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d3858339-4ebb-4617-a2b5-77d7c0e24313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:52.373010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f6b3a-8c8e-48ae-8be8-102fda0176ba None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:52.411377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:52.426076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 141/287] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:52.436484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe09a8-c6d9-4877-b94f-27355c8700de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:52.437431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe09a8-c6d9-4877-b94f-27355c8700de None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:52.437901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe09a8-c6d9-4877-b94f-27355c8700de None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:52.438428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe09a8-c6d9-4877-b94f-27355c8700de None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/users/6deab9883b494ae69769695cd6b37b8d/roles/00e163951e5f442fba065051ae50ed7d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:52.440615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe09a8-c6d9-4877-b94f-27355c8700de None admin] RBAC: Authorizing `identity:create_grant(project_id=77531e28ab5e4a9f970bf1dea34d9442, user_id=6deab9883b494ae69769695cd6b37b8d, role_id=00e163951e5f442fba065051ae50ed7d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:52.442929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe09a8-c6d9-4877-b94f-27355c8700de None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:52.458264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 147/288] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:04:52 2022] PUT /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/users/6deab9883b494ae69769695cd6b37b8d/roles/00e163951e5f442fba065051ae50ed7d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:52.798970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858339-4ebb-4617-a2b5-77d7c0e24313 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:52.924884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858339-4ebb-4617-a2b5-77d7c0e24313 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:52.973167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261a65b-5aa3-4f6c-a167-85031cf1c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:52.973825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261a65b-5aa3-4f6c-a167-85031cf1c36d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:52.974109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261a65b-5aa3-4f6c-a167-85031cf1c36d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:52.974388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261a65b-5aa3-4f6c-a167-85031cf1c36d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:52.991885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261a65b-5aa3-4f6c-a167-85031cf1c36d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-8261a65b-5aa3-4f6c-a167-85031cf1c36d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:52.997416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:52.998262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:52.999041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 142/289] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:53.004677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe09a8-c6d9-4877-b94f-27355c8700de None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:53.075550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:53.117781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe09a8-c6d9-4877-b94f-27355c8700de None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:53.154122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:53.155127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.155650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.156133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.157079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:53.157625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:53.159335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:53.169642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 148/290] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:53.175296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261a65b-5aa3-4f6c-a167-85031cf1c36d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:53.271973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:53.350967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261a65b-5aa3-4f6c-a167-85031cf1c36d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:53.393026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d03f1-3548-4e00-9cf5-56ec7351e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:53.393958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d03f1-3548-4e00-9cf5-56ec7351e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.394429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d03f1-3548-4e00-9cf5-56ec7351e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.394880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d03f1-3548-4e00-9cf5-56ec7351e8d0 None admin] PATH_INFO: `/v3/users/03bc2371c2cb4b07b6044bd3053e73b2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.396235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d03f1-3548-4e00-9cf5-56ec7351e8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=03bc2371c2cb4b07b6044bd3053e73b2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:53.397837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d03f1-3548-4e00-9cf5-56ec7351e8d0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:53.399618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 143/291] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:53 2022] GET /identity/v3/users/03bc2371c2cb4b07b6044bd3053e73b2 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:53.408305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:53.541002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d51c85-f948-4ce4-afbd-9d8fafdcbab9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:53.567955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:53.585462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55854b5-1d9f-4f52-8518-96ac47776c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:53.586077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55854b5-1d9f-4f52-8518-96ac47776c27 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.586355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55854b5-1d9f-4f52-8518-96ac47776c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.586626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55854b5-1d9f-4f52-8518-96ac47776c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.670131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55854b5-1d9f-4f52-8518-96ac47776c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:53.671559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55854b5-1d9f-4f52-8518-96ac47776c27 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:53.699941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2c68-1213-4a18-aa83-86fc2021a6e8 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.700247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2c68-1213-4a18-aa83-86fc2021a6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.700492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b2c68-1213-4a18-aa83-86fc2021a6e8 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.701857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 144/292] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:53.707446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3d88-71be-48dd-a576-ef42584119c9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.707732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3d88-71be-48dd-a576-ef42584119c9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.708012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3d88-71be-48dd-a576-ef42584119c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.754929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9c0f3d88-71be-48dd-a576-ef42584119c9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:53.756234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9c0f3d88-71be-48dd-a576-ef42584119c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:53.825383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 149/293] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:53.826752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274516-9870-4548-ae65-ce89e90ed6e1 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.827044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274516-9870-4548-ae65-ce89e90ed6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.827985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f274516-9870-4548-ae65-ce89e90ed6e1 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.833153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 150/294] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:53.833153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274516-9870-4548-ae65-ce89e90ed6e1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:53.861669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:53.863720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 145/295] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:53.873120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a703df-578d-4181-ba55-3b3de5c7e94b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.873713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a703df-578d-4181-ba55-3b3de5c7e94b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.874193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a703df-578d-4181-ba55-3b3de5c7e94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.898720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-06a703df-578d-4181-ba55-3b3de5c7e94b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:53.900888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-06a703df-578d-4181-ba55-3b3de5c7e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:53.940275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f274516-9870-4548-ae65-ce89e90ed6e1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:53.970397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:53.987879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed8ed3-ad4b-4852-b4ba-6321cdde3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:53.988782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed8ed3-ad4b-4852-b4ba-6321cdde3de5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.989435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed8ed3-ad4b-4852-b4ba-6321cdde3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.989932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed8ed3-ad4b-4852-b4ba-6321cdde3de5 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.991132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 146/296] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:53.991492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed8ed3-ad4b-4852-b4ba-6321cdde3de5 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:53.992418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764f0b-2487-4b89-acdf-fc29a84be8b8 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:53.992702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764f0b-2487-4b89-acdf-fc29a84be8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:53.993038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764f0b-2487-4b89-acdf-fc29a84be8b8 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:53.993802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed8ed3-ad4b-4852-b4ba-6321cdde3de5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:53.994730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 147/297] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:53.996431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 151/298] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:53 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:54.000467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b423-5803-4ae6-83c5-79694bde34f2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.001039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b423-5803-4ae6-83c5-79694bde34f2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.001505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63b423-5803-4ae6-83c5-79694bde34f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.003981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed8ed3-ad4b-4852-b4ba-6321cdde3de5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.044583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7d63b423-5803-4ae6-83c5-79694bde34f2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:54.046161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7d63b423-5803-4ae6-83c5-79694bde34f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:54.158701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 148/299] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:54.163811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63b423-5803-4ae6-83c5-79694bde34f2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.179206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:54.186844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed8ed3-ad4b-4852-b4ba-6321cdde3de5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:54.222303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:54.222911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.223214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.223486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.224210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] RBAC: Adding query filter params (role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442, user.id=03bc2371c2cb4b07b6044bd3053e73b2) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:54.224727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:54.225932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:54.233014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 152/300] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/role_assignments?user.id=03bc2371c2cb4b07b6044bd3053e73b2&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:54.286594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63b423-5803-4ae6-83c5-79694bde34f2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:54.303917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:54.318282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.328867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c93b5-83dc-4f87-93cc-3075cd5dba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:54.329517 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c93b5-83dc-4f87-93cc-3075cd5dba29 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.329798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c93b5-83dc-4f87-93cc-3075cd5dba29 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.330074 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c93b5-83dc-4f87-93cc-3075cd5dba29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.343167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c93b5-83dc-4f87-93cc-3075cd5dba29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-6f1c93b5-83dc-4f87-93cc-3075cd5dba29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:54.348555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:54.349482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:54.350265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:54.350853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 149/301] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:54.363027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c93b5-83dc-4f87-93cc-3075cd5dba29 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.505920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c93b5-83dc-4f87-93cc-3075cd5dba29 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:54.517885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e5481-bed8-425e-933a-8796db7f7c67 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:54.546277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:54.546878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.547200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.547476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.548167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:54.548470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:54.549828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:54.559058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 150/302] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:54.559845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.567026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9148b3c-5a16-4a06-93d2-85c4781f2125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:54.567303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9148b3c-5a16-4a06-93d2-85c4781f2125 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.569301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9148b3c-5a16-4a06-93d2-85c4781f2125 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.569301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9148b3c-5a16-4a06-93d2-85c4781f2125 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.570291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9148b3c-5a16-4a06-93d2-85c4781f2125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:54.571826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9148b3c-5a16-4a06-93d2-85c4781f2125 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:54.574245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 153/303] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:04:54.575120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9148b3c-5a16-4a06-93d2-85c4781f2125 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.602287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:54.607350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:54.684247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ca722-24a1-4390-abb5-7a84845cdb1d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:54.694178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9148b3c-5a16-4a06-93d2-85c4781f2125 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:54.726908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5d63-f175-4671-ad91-9f6f565c4960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:54.727579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5d63-f175-4671-ad91-9f6f565c4960 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.727851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5d63-f175-4671-ad91-9f6f565c4960 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.728126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5d63-f175-4671-ad91-9f6f565c4960 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.728724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af4aa5-c6c2-4895-b4fe-b66ba65df58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:54.730109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af4aa5-c6c2-4895-b4fe-b66ba65df58f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.730339 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af4aa5-c6c2-4895-b4fe-b66ba65df58f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.730879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af4aa5-c6c2-4895-b4fe-b66ba65df58f None admin] PATH_INFO: `/v3/users/0887697ba30149cb92d82d5d2304788f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.740195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5d63-f175-4671-ad91-9f6f565c4960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d97e5d63-f175-4671-ad91-9f6f565c4960 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:54.746073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:54.746929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:54.751931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:04:54.752567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af4aa5-c6c2-4895-b4fe-b66ba65df58f None admin] RBAC: Authorizing `identity:get_user(user_id=0887697ba30149cb92d82d5d2304788f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:54.752650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 151/304] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:54.752650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5d63-f175-4671-ad91-9f6f565c4960 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.752819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af4aa5-c6c2-4895-b4fe-b66ba65df58f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:54.752819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 154/305] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/users/0887697ba30149cb92d82d5d2304788f => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:54.753966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af4aa5-c6c2-4895-b4fe-b66ba65df58f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.844116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:54.857987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:54.862154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af4aa5-c6c2-4895-b4fe-b66ba65df58f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:54.864820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5d63-f175-4671-ad91-9f6f565c4960 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:54.898703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:54.899341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.899619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.899893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.900562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:54.901680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:54.902307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d266b-5490-4e6f-b8ee-e5326609fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:54.902918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d266b-5490-4e6f-b8ee-e5326609fd11 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:54.903044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:54.903224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d266b-5490-4e6f-b8ee-e5326609fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:54.903496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d266b-5490-4e6f-b8ee-e5326609fd11 None admin] PATH_INFO: `/v3/groups` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:54.904144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d266b-5490-4e6f-b8ee-e5326609fd11 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:54.905770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d266b-5490-4e6f-b8ee-e5326609fd11 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:54.915984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 155/306] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:54.915984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:54.935017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 152/307] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Sep 16 19:04:54 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:04:54.935017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d266b-5490-4e6f-b8ee-e5326609fd11 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:55.042437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8128-bd97-43b4-b43c-34af7f432d20 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:55.092047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:55.093032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:55.093450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:55.093959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:55.094984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] RBAC: Adding query filter params (role.id=00e163951e5f442fba065051ae50ed7d, user.id=0887697ba30149cb92d82d5d2304788f, scope.system=all) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:55.095549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:55.096942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d266b-5490-4e6f-b8ee-e5326609fd11 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:55.097607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:55.106054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 156/308] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/role_assignments?user.id=0887697ba30149cb92d82d5d2304788f&scope.system=all&role.id=00e163951e5f442fba065051ae50ed7d => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:55.157970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a63310-1577-4634-9713-7d9d5a1987c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:55.158633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a63310-1577-4634-9713-7d9d5a1987c3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:55.158914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a63310-1577-4634-9713-7d9d5a1987c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:55.159222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a63310-1577-4634-9713-7d9d5a1987c3 None admin] PATH_INFO: `/v3/users/b92a1ec2f892458a9a31a8ac0136b6b2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:55.160392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a63310-1577-4634-9713-7d9d5a1987c3 None admin] RBAC: Authorizing `identity:get_user(user_id=b92a1ec2f892458a9a31a8ac0136b6b2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:55.161861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a63310-1577-4634-9713-7d9d5a1987c3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:55.163885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 153/309] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:54 2022] GET /identity/v3/users/b92a1ec2f892458a9a31a8ac0136b6b2 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:55.170113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:55.185037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:55.243556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5979fc-8e7a-44db-a5f6-2678476a4fa2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:55.244072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5979fc-8e7a-44db-a5f6-2678476a4fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:55.244606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5979fc-8e7a-44db-a5f6-2678476a4fa2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:55.246326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 154/310] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:55.252598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3953b-a42b-4bae-879b-037608b0e313 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:55.253207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3953b-a42b-4bae-879b-037608b0e313 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:55.253706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3953b-a42b-4bae-879b-037608b0e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:55.274234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-59b3953b-a42b-4bae-879b-037608b0e313 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:55.275914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-59b3953b-a42b-4bae-879b-037608b0e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:55.289428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4e583-816a-4cd7-a327-31c80e9cbd99 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:55.303679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:55.331094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5596-0e0c-4965-91f6-ffc576aec5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:55.332152 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5596-0e0c-4965-91f6-ffc576aec5a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:55.332447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5596-0e0c-4965-91f6-ffc576aec5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:55.332733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e5596-0e0c-4965-91f6-ffc576aec5a0 None admin] PATH_INFO: `/v3/system/users/b92a1ec2f892458a9a31a8ac0136b6b2/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:55.334505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e5596-0e0c-4965-91f6-ffc576aec5a0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b92a1ec2f892458a9a31a8ac0136b6b2, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:55.336272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e5596-0e0c-4965-91f6-ffc576aec5a0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:55.355136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 157/311] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Sep 16 19:04:55 2022] PUT /identity/v3/system/users/b92a1ec2f892458a9a31a8ac0136b6b2/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:04:55.367463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 155/312] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:55.654177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5596-0e0c-4965-91f6-ffc576aec5a0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:55.731802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:55.758910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e5596-0e0c-4965-91f6-ffc576aec5a0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:55.795451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79be47f-bad0-4afd-ba3d-3b3688f40a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:55.796155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79be47f-bad0-4afd-ba3d-3b3688f40a71 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:55.796444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79be47f-bad0-4afd-ba3d-3b3688f40a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:55.796719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79be47f-bad0-4afd-ba3d-3b3688f40a71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:55.808375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79be47f-bad0-4afd-ba3d-3b3688f40a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b79be47f-bad0-4afd-ba3d-3b3688f40a71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:55.813752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:55.814627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:55.815848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 158/313] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:55.821013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3953b-a42b-4bae-879b-037608b0e313 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:55.928047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3953b-a42b-4bae-879b-037608b0e313 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:55.964589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:55.965223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:55.965506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:55.965780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:55.966475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:55.966779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:55.968308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:55.978483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 156/314] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:55.984759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79be47f-bad0-4afd-ba3d-3b3688f40a71 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:56.093567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79be47f-bad0-4afd-ba3d-3b3688f40a71 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:56.128953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602342f4-1fcc-4eb0-ae02-ae8048703827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:56.129583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602342f4-1fcc-4eb0-ae02-ae8048703827 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:56.129908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602342f4-1fcc-4eb0-ae02-ae8048703827 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:56.130188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602342f4-1fcc-4eb0-ae02-ae8048703827 None admin] PATH_INFO: `/v3/users/6deab9883b494ae69769695cd6b37b8d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:56.131334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602342f4-1fcc-4eb0-ae02-ae8048703827 None admin] RBAC: Authorizing `identity:get_user(user_id=6deab9883b494ae69769695cd6b37b8d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:56.132842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602342f4-1fcc-4eb0-ae02-ae8048703827 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:56.134779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 159/315] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:55 2022] GET /identity/v3/users/6deab9883b494ae69769695cd6b37b8d => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:56.140526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:56.160457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:56.250234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395cf16-1db2-4843-8fff-4d4314e438e3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:56.286574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f8b1b-a813-45ce-a567-ecb9e4a80064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:56.287218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8b1b-a813-45ce-a567-ecb9e4a80064 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:56.287501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8b1b-a813-45ce-a567-ecb9e4a80064 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:56.287781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f8b1b-a813-45ce-a567-ecb9e4a80064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:56.359243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f8b1b-a813-45ce-a567-ecb9e4a80064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:56.360784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f8b1b-a813-45ce-a567-ecb9e4a80064 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:56.379353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:56.469996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 157/316] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:04:56.475635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602342f4-1fcc-4eb0-ae02-ae8048703827 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:56.479459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:56.586713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602342f4-1fcc-4eb0-ae02-ae8048703827 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:56.622326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b2758-aa78-4ee9-a37a-fa39f5ba698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:56.622962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2758-aa78-4ee9-a37a-fa39f5ba698a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:56.623271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2758-aa78-4ee9-a37a-fa39f5ba698a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:56.623542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2758-aa78-4ee9-a37a-fa39f5ba698a None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:56.624663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b2758-aa78-4ee9-a37a-fa39f5ba698a None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:56.626103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b2758-aa78-4ee9-a37a-fa39f5ba698a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:56.628061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 160/317] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:04:56 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:56.633768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f8b1b-a813-45ce-a567-ecb9e4a80064 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:56.735659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f8b1b-a813-45ce-a567-ecb9e4a80064 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:56.752748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:56.773004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36999a02-95c3-4f7f-bbe4-2390aaf435f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:56.773934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999a02-95c3-4f7f-bbe4-2390aaf435f3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:56.774416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999a02-95c3-4f7f-bbe4-2390aaf435f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:56.774947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999a02-95c3-4f7f-bbe4-2390aaf435f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:56.776082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36999a02-95c3-4f7f-bbe4-2390aaf435f3 None admin] RBAC: Adding query filter params (role.id=00e163951e5f442fba065051ae50ed7d, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442, user.id=6deab9883b494ae69769695cd6b37b8d) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:56.776758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36999a02-95c3-4f7f-bbe4-2390aaf435f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:56.778433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36999a02-95c3-4f7f-bbe4-2390aaf435f3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:56.784715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 158/318] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:04:56 2022] GET /identity/v3/role_assignments?user.id=6deab9883b494ae69769695cd6b37b8d&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=00e163951e5f442fba065051ae50ed7d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:57.339011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fbfe-8e9a-4ecb-b0c9-89b98b8c96cc None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:57.339408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fbfe-8e9a-4ecb-b0c9-89b98b8c96cc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:57.339632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499fbfe-8e9a-4ecb-b0c9-89b98b8c96cc None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:57.341117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 161/319] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:57.346124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab657-3a7f-4c23-b4c8-fd58ef66726c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:57.346559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab657-3a7f-4c23-b4c8-fd58ef66726c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:57.346719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab657-3a7f-4c23-b4c8-fd58ef66726c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:57.365591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-78eab657-3a7f-4c23-b4c8-fd58ef66726c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:57.366792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-78eab657-3a7f-4c23-b4c8-fd58ef66726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:57.400077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4676-f59a-4f67-83bb-bfe5f2d163e3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:57.400371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4676-f59a-4f67-83bb-bfe5f2d163e3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:57.400631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd4676-f59a-4f67-83bb-bfe5f2d163e3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:57.402421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 162/320] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:04:57.407485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccbdf9-0ab8-4834-936d-08e4685b595f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:57.407772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccbdf9-0ab8-4834-936d-08e4685b595f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:57.408055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccbdf9-0ab8-4834-936d-08e4685b595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:57.427965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-26ccbdf9-0ab8-4834-936d-08e4685b595f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:57.429240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-26ccbdf9-0ab8-4834-936d-08e4685b595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:57.450531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 159/321] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:57.496656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:57.503030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 163/322] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:04:57.535595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1742-dcb1-491c-8a97-c5371232716b None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:57.535872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1742-dcb1-491c-8a97-c5371232716b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:57.536148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1742-dcb1-491c-8a97-c5371232716b None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:57.537632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 160/323] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:04:57.543224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f5a47-7682-4161-904b-3b68a44f772e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:57.543511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f5a47-7682-4161-904b-3b68a44f772e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:57.543781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f5a47-7682-4161-904b-3b68a44f772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:57.562175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f11f5a47-7682-4161-904b-3b68a44f772e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:04:57.563385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f11f5a47-7682-4161-904b-3b68a44f772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:04:57.628864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 164/324] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:04:57.723915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc1742-dcb1-491c-8a97-c5371232716b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:57.774907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f5a47-7682-4161-904b-3b68a44f772e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:57.834496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc1742-dcb1-491c-8a97-c5371232716b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:57.848532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:57.875842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c1752-6f80-4326-82a3-6edd8ede3ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:57.876473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c1752-6f80-4326-82a3-6edd8ede3ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:57.876817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c1752-6f80-4326-82a3-6edd8ede3ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:57.877099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c1752-6f80-4326-82a3-6edd8ede3ab8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:57.878234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c1752-6f80-4326-82a3-6edd8ede3ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:57.879760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c1752-6f80-4326-82a3-6edd8ede3ab8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:57.880495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f5a47-7682-4161-904b-3b68a44f772e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:57.881437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 161/325] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:04:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:57.886910 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c1752-6f80-4326-82a3-6edd8ede3ab8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:57.910752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:57.917696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f508-5705-4e57-b0a1-f2cfc8bb9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:57.918324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f508-5705-4e57-b0a1-f2cfc8bb9830 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:57.918603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f508-5705-4e57-b0a1-f2cfc8bb9830 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:57.918879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204f508-5705-4e57-b0a1-f2cfc8bb9830 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:57.928597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204f508-5705-4e57-b0a1-f2cfc8bb9830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-5204f508-5705-4e57-b0a1-f2cfc8bb9830 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:57.933470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:57.934445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:57.935276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 165/326] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:04:57.936526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f508-5705-4e57-b0a1-f2cfc8bb9830 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:57.987655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c1752-6f80-4326-82a3-6edd8ede3ab8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:58.020711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a7bb-327b-4506-bd85-3ff8428a7602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:58.021302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a7bb-327b-4506-bd85-3ff8428a7602 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:58.021577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a7bb-327b-4506-bd85-3ff8428a7602 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:58.021846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a7bb-327b-4506-bd85-3ff8428a7602 None admin] PATH_INFO: `/v3/groups` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:58.022463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671a7bb-327b-4506-bd85-3ff8428a7602 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:58.023920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671a7bb-327b-4506-bd85-3ff8428a7602 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:58.039257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 162/327] 10.222.0.20 () {60 vars in 1134 bytes} [Fri Sep 16 19:04:57 2022] POST /identity/v3/groups => generated 226 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:04:58.043209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204f508-5705-4e57-b0a1-f2cfc8bb9830 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:58.048250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a7bb-327b-4506-bd85-3ff8428a7602 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:58.081695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b29cc1-5072-4883-9aab-3fc31ccd92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:58.082333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b29cc1-5072-4883-9aab-3fc31ccd92da None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:58.082607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b29cc1-5072-4883-9aab-3fc31ccd92da None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:58.083089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b29cc1-5072-4883-9aab-3fc31ccd92da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:58.095595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b29cc1-5072-4883-9aab-3fc31ccd92da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:04:58.099737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f6b29cc1-5072-4883-9aab-3fc31ccd92da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:04:58.100582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:04:58.101438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:04:58.102477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 166/328] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:04:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:04:58.108249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b29cc1-5072-4883-9aab-3fc31ccd92da None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:58.169437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:58.182902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a7bb-327b-4506-bd85-3ff8428a7602 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:58.227935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:58.228563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:58.229347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:58.229689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:58.231033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:58.231033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:58.232357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:58.232681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b29cc1-5072-4883-9aab-3fc31ccd92da None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:58.243470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 163/329] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:58.250890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:58.282140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:58.282757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:58.283699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:58.283699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:58.284072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:58.284381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:58.285767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:58.295431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 167/330] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:04:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:58.300754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:58.384882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:58.388916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59b54-29d8-4b8c-91df-ea77ea6231e2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:58.428887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab7ff0-a91e-41c7-bc80-5bb8ecd5888f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:58.445072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:04:58.446453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea3de-d5fb-4ded-959e-a8f3ef01fec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:58.448338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea3de-d5fb-4ded-959e-a8f3ef01fec3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:58.448580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea3de-d5fb-4ded-959e-a8f3ef01fec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:58.448864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ea3de-d5fb-4ded-959e-a8f3ef01fec3 None admin] PATH_INFO: `/v3/users/0887697ba30149cb92d82d5d2304788f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:58.450420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ea3de-d5fb-4ded-959e-a8f3ef01fec3 None admin] RBAC: Authorizing `identity:get_user(user_id=0887697ba30149cb92d82d5d2304788f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:58.452333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ea3de-d5fb-4ded-959e-a8f3ef01fec3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:58.453609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 164/331] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:58 2022] GET /identity/v3/users/0887697ba30149cb92d82d5d2304788f => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:58.458822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea3de-d5fb-4ded-959e-a8f3ef01fec3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:58.492608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355196fa-a940-4526-b2be-0e879c9a3e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:58.493721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355196fa-a940-4526-b2be-0e879c9a3e67 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:58.493861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355196fa-a940-4526-b2be-0e879c9a3e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:58.494070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355196fa-a940-4526-b2be-0e879c9a3e67 None admin] PATH_INFO: `/v3/users/b92a1ec2f892458a9a31a8ac0136b6b2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:58.496038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355196fa-a940-4526-b2be-0e879c9a3e67 None admin] RBAC: Authorizing `identity:get_user(user_id=b92a1ec2f892458a9a31a8ac0136b6b2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:58.497855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355196fa-a940-4526-b2be-0e879c9a3e67 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:58.504603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 168/332] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:04:58 2022] GET /identity/v3/users/b92a1ec2f892458a9a31a8ac0136b6b2 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:04:58.506502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355196fa-a940-4526-b2be-0e879c9a3e67 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:04:58.604837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ea3de-d5fb-4ded-959e-a8f3ef01fec3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:58.641647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355196fa-a940-4526-b2be-0e879c9a3e67 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:04:58.651422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f88877-ba8a-4f4b-ba9c-c86ce83f7e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:58.652487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f88877-ba8a-4f4b-ba9c-c86ce83f7e87 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:58.652771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f88877-ba8a-4f4b-ba9c-c86ce83f7e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:58.653047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f88877-ba8a-4f4b-ba9c-c86ce83f7e87 None admin] PATH_INFO: `/v3/system/users/0887697ba30149cb92d82d5d2304788f/roles/00e163951e5f442fba065051ae50ed7d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:58.657083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f88877-ba8a-4f4b-ba9c-c86ce83f7e87 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0887697ba30149cb92d82d5d2304788f, role_id=00e163951e5f442fba065051ae50ed7d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:58.658792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f88877-ba8a-4f4b-ba9c-c86ce83f7e87 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:58.670964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 165/333] 10.222.0.20 () {58 vars in 1334 bytes} [Fri Sep 16 19:04:58 2022] PUT /identity/v3/system/users/0887697ba30149cb92d82d5d2304788f/roles/00e163951e5f442fba065051ae50ed7d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:04:58.699491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2dd4e-b229-435e-8788-f30a05f8eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:04:58.700195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2dd4e-b229-435e-8788-f30a05f8eb65 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:04:58.700475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2dd4e-b229-435e-8788-f30a05f8eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:04:58.700754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2dd4e-b229-435e-8788-f30a05f8eb65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:04:58.701578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2dd4e-b229-435e-8788-f30a05f8eb65 None admin] RBAC: Adding query filter params (role.id=f686c7083ea64f748bfab4a77dd732e2, user.id=b92a1ec2f892458a9a31a8ac0136b6b2, scope.system=all) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:04:58.701960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2dd4e-b229-435e-8788-f30a05f8eb65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:04:58.703487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2dd4e-b229-435e-8788-f30a05f8eb65 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:04:58.719503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 169/334] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 16 19:04:58 2022] GET /identity/v3/role_assignments?user.id=b92a1ec2f892458a9a31a8ac0136b6b2&scope.system=all&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:00.518718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1102-c641-4944-9d20-1eca16095d9b None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:00.519605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1102-c641-4944-9d20-1eca16095d9b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:00.520027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad1102-c641-4944-9d20-1eca16095d9b None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:00.521797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 166/335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:00.527699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458f2db-fee4-4a19-bf2c-1ce2a25db17b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:00.528560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458f2db-fee4-4a19-bf2c-1ce2a25db17b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:00.529041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458f2db-fee4-4a19-bf2c-1ce2a25db17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:00.550938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0458f2db-fee4-4a19-bf2c-1ce2a25db17b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:00.552225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0458f2db-fee4-4a19-bf2c-1ce2a25db17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:00.589080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:00.633429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 170/336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:01.071551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91dfb-7a01-454c-a653-7c3dcac568fb None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:01.071922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91dfb-7a01-454c-a653-7c3dcac568fb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:01.072176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b91dfb-7a01-454c-a653-7c3dcac568fb None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:01.074026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 167/337] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:01.079426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316d28-d7a5-418a-bfe2-4b17f605c798 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:01.079800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316d28-d7a5-418a-bfe2-4b17f605c798 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:01.080080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316d28-d7a5-418a-bfe2-4b17f605c798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:01.108041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bf316d28-d7a5-418a-bfe2-4b17f605c798 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:01.109256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bf316d28-d7a5-418a-bfe2-4b17f605c798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:01.194330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 171/338] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:01.224356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b91dfb-7a01-454c-a653-7c3dcac568fb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:01.267347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:01.352964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b91dfb-7a01-454c-a653-7c3dcac568fb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:01.395834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a003f2-e32b-4623-952e-3be1987480af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:01.396489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a003f2-e32b-4623-952e-3be1987480af None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:01.396774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a003f2-e32b-4623-952e-3be1987480af None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:01.397059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a003f2-e32b-4623-952e-3be1987480af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:01.409964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a003f2-e32b-4623-952e-3be1987480af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-30a003f2-e32b-4623-952e-3be1987480af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:01.415994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:01.417485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:01.418248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:01.421740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 168/339] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:01.424225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf316d28-d7a5-418a-bfe2-4b17f605c798 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:01.548378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:01.553545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf316d28-d7a5-418a-bfe2-4b17f605c798 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:01.557714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035b37-ebfe-4587-a39c-67aba302aaa0 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:01.558643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035b37-ebfe-4587-a39c-67aba302aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:01.559166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f035b37-ebfe-4587-a39c-67aba302aaa0 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:01.560651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 169/340] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:05:01.568265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884a07b-a9fc-4f6b-a9d2-9c6c4b163e1d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:01.568863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884a07b-a9fc-4f6b-a9d2-9c6c4b163e1d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:01.569344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884a07b-a9fc-4f6b-a9d2-9c6c4b163e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:01.592013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9884a07b-a9fc-4f6b-a9d2-9c6c4b163e1d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:01.593546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9884a07b-a9fc-4f6b-a9d2-9c6c4b163e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:01.609939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:01.610865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:01.611387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:01.611855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:01.612882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:01.614763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:01.616364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:01.638353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 172/341] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:05:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:01.647941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:01.720970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 170/342] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:01.827875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884a07b-a9fc-4f6b-a9d2-9c6c4b163e1d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:01.866168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b49ab-34e4-49a2-af4d-6b28093184c1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:01.875550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:01.910081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e011f5-b816-4f5f-96f9-0f804f7992d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:01.910699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e011f5-b816-4f5f-96f9-0f804f7992d7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:01.910975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e011f5-b816-4f5f-96f9-0f804f7992d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:01.911269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e011f5-b816-4f5f-96f9-0f804f7992d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:01.972328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:02.021692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884a07b-a9fc-4f6b-a9d2-9c6c4b163e1d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:02.042366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e011f5-b816-4f5f-96f9-0f804f7992d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:02.043882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e011f5-b816-4f5f-96f9-0f804f7992d7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:02.119859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b8f1-c4c9-4d75-b65d-00068ebe6224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:02.120633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b8f1-c4c9-4d75-b65d-00068ebe6224 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.120916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b8f1-c4c9-4d75-b65d-00068ebe6224 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.121193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b8f1-c4c9-4d75-b65d-00068ebe6224 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.137514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b8f1-c4c9-4d75-b65d-00068ebe6224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-5ab8b8f1-c4c9-4d75-b65d-00068ebe6224 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:02.143761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:02.144677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:02.145459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:02.148589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 171/343] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:05:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:02.149966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6076-a22b-45c3-8008-f36d53492bba None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.150426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6076-a22b-45c3-8008-f36d53492bba None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.151128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6076-a22b-45c3-8008-f36d53492bba None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.152987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 172/344] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:02.153843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6076-a22b-45c3-8008-f36d53492bba None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:02.192073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 173/345] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:02.193294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e011f5-b816-4f5f-96f9-0f804f7992d7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:02.263428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:02.267708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:02.291502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6076-a22b-45c3-8008-f36d53492bba None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:02.313618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e011f5-b816-4f5f-96f9-0f804f7992d7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:02.336462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d4f9e-afda-47a4-8322-96983218bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:02.337941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4f9e-afda-47a4-8322-96983218bba2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.338906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4f9e-afda-47a4-8322-96983218bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.339420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d4f9e-afda-47a4-8322-96983218bba2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.354189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d4f9e-afda-47a4-8322-96983218bba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:02.357143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:02.358019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.358499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.358968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ec2d4f9e-afda-47a4-8322-96983218bba2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:02.359467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:02.360335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:02.361137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 173/346] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:02.361798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625570-f93a-430f-a7d3-7d065ecc45d6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.362008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625570-f93a-430f-a7d3-7d065ecc45d6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.362423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625570-f93a-430f-a7d3-7d065ecc45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.362889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:02.363321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:02.364811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:02.381283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 174/347] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:02.382317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:02.396925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-24625570-f93a-430f-a7d3-7d065ecc45d6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:02.398865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-24625570-f93a-430f-a7d3-7d065ecc45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:02.501527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 174/348] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:02.502598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24625570-f93a-430f-a7d3-7d065ecc45d6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:02.539140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41664-d052-4e5b-8012-43ed34be5af8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:02.584981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:02.585858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:02.615437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a4f3e-a869-4e38-8d2c-d00357f35835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:02.616859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a4f3e-a869-4e38-8d2c-d00357f35835 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.617765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a4f3e-a869-4e38-8d2c-d00357f35835 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.618280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a4f3e-a869-4e38-8d2c-d00357f35835 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.621285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a4f3e-a869-4e38-8d2c-d00357f35835 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:02.622710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24625570-f93a-430f-a7d3-7d065ecc45d6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:02.623383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a4f3e-a869-4e38-8d2c-d00357f35835 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:02.625657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 175/349] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:02 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:02.626986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a4f3e-a869-4e38-8d2c-d00357f35835 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:02.670521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:02.672474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.673134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.675731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.677277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:02.677585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:02.679519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:02.689287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 175/350] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:05:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:02.690156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:02.785629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a4f3e-a869-4e38-8d2c-d00357f35835 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:02.815648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f87b40-34ed-40b4-b4ad-b426688620af None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:02.832864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b1186-6acb-419a-95f7-99af8abef72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:02.834241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1186-6acb-419a-95f7-99af8abef72c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.834731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1186-6acb-419a-95f7-99af8abef72c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.835252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b1186-6acb-419a-95f7-99af8abef72c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.860317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd8cc2-a3ff-4010-b428-994b3388a6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:02.860915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8cc2-a3ff-4010-b428-994b3388a6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:02.861202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8cc2-a3ff-4010-b428-994b3388a6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:02.861483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd8cc2-a3ff-4010-b428-994b3388a6c8 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:02.867363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:02.868147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd8cc2-a3ff-4010-b428-994b3388a6c8 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:02.869978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd8cc2-a3ff-4010-b428-994b3388a6c8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:02.872478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 176/351] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:02 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:02.873273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd8cc2-a3ff-4010-b428-994b3388a6c8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:02.913305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:02.928009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b1186-6acb-419a-95f7-99af8abef72c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:02.930366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b1186-6acb-419a-95f7-99af8abef72c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:02.992170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd8cc2-a3ff-4010-b428-994b3388a6c8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.039349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0f6bd-5214-463b-8e2e-94052f73a5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:03.040078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0f6bd-5214-463b-8e2e-94052f73a5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.040425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0f6bd-5214-463b-8e2e-94052f73a5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.040770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0f6bd-5214-463b-8e2e-94052f73a5a5 None admin] PATH_INFO: `/v3/users/0887697ba30149cb92d82d5d2304788f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.044033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0f6bd-5214-463b-8e2e-94052f73a5a5 None admin] RBAC: Authorizing `identity:get_user(user_id=0887697ba30149cb92d82d5d2304788f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:03.045615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0f6bd-5214-463b-8e2e-94052f73a5a5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:03.046929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 177/352] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:05:02 2022] GET /identity/v3/users/0887697ba30149cb92d82d5d2304788f => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:03.047729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0f6bd-5214-463b-8e2e-94052f73a5a5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:03.060037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 176/353] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:03.062249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99774aaa-fe4a-415f-a2c3-289ae528f831 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.063204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99774aaa-fe4a-415f-a2c3-289ae528f831 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.063682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99774aaa-fe4a-415f-a2c3-289ae528f831 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.065877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 177/354] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:03.066822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99774aaa-fe4a-415f-a2c3-289ae528f831 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:03.136494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:03.179443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0f6bd-5214-463b-8e2e-94052f73a5a5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.179624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:03.196186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99774aaa-fe4a-415f-a2c3-289ae528f831 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.221958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:03.221958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.221958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.221958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.222355 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] RBAC: Adding query filter params (group.id=7268ecfee1e049f5a0838bd197f462b6, role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=8364b69580ec486c8b430bf6e13ce028) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:03.222355 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:03.222920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:03.232545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 178/355] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:03 2022] GET /identity/v3/role_assignments?group.id=7268ecfee1e049f5a0838bd197f462b6&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:03.233423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:03.234810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04e61d-ceb5-422f-ac1b-539ca11fcfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:03.235565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04e61d-ceb5-422f-ac1b-539ca11fcfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.235848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04e61d-ceb5-422f-ac1b-539ca11fcfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.236345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04e61d-ceb5-422f-ac1b-539ca11fcfa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.253093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04e61d-ceb5-422f-ac1b-539ca11fcfa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6e04e61d-ceb5-422f-ac1b-539ca11fcfa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:03.258520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:03.259553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 178/356] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:03.260536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04e61d-ceb5-422f-ac1b-539ca11fcfa0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:03.368363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8a1e2-749b-4f2b-b7c5-351e95e9d31d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.401752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04e61d-ceb5-422f-ac1b-539ca11fcfa0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.407857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:03.414604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f632f8d-c11f-40e6-8097-d61aa3fbd9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:03.415390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632f8d-c11f-40e6-8097-d61aa3fbd9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.415665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632f8d-c11f-40e6-8097-d61aa3fbd9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.415936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f632f8d-c11f-40e6-8097-d61aa3fbd9c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.419141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f632f8d-c11f-40e6-8097-d61aa3fbd9c6 None admin] RBAC: Adding query filter params (role.id=00e163951e5f442fba065051ae50ed7d, user.id=0887697ba30149cb92d82d5d2304788f, scope.system=all) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:03.419141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f632f8d-c11f-40e6-8097-d61aa3fbd9c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:03.419141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f632f8d-c11f-40e6-8097-d61aa3fbd9c6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:03.443762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 179/357] 10.222.0.20 () {56 vars in 1308 bytes} [Fri Sep 16 19:05:03 2022] GET /identity/v3/role_assignments?user.id=0887697ba30149cb92d82d5d2304788f&scope.system=all&role.id=00e163951e5f442fba065051ae50ed7d => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:03.445095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302688-b9b6-41c1-947a-5090bc00899b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.445383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302688-b9b6-41c1-947a-5090bc00899b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.445658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302688-b9b6-41c1-947a-5090bc00899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.455283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd2b25-06af-4a06-b8f3-49d00f89063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:03.456340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd2b25-06af-4a06-b8f3-49d00f89063f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.456823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd2b25-06af-4a06-b8f3-49d00f89063f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.457331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd2b25-06af-4a06-b8f3-49d00f89063f None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.458876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd2b25-06af-4a06-b8f3-49d00f89063f None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:03.461652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd2b25-06af-4a06-b8f3-49d00f89063f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:03.469998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-51302688-b9b6-41c1-947a-5090bc00899b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:03.469998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-51302688-b9b6-41c1-947a-5090bc00899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:03.470655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 179/358] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:03 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:03.472484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d88ed0-3c16-4b1c-9e9f-e978417fb8a9 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.472983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d88ed0-3c16-4b1c-9e9f-e978417fb8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.473459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d88ed0-3c16-4b1c-9e9f-e978417fb8a9 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.475432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 180/359] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:03.476452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d88ed0-3c16-4b1c-9e9f-e978417fb8a9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:03.509840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:03.563621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 180/360] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:03.564864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302688-b9b6-41c1-947a-5090bc00899b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:03.670230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d88ed0-3c16-4b1c-9e9f-e978417fb8a9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.711328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63323c1-a3fc-4ccd-bed6-cba2802d4deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:03.711983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63323c1-a3fc-4ccd-bed6-cba2802d4deb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.712268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63323c1-a3fc-4ccd-bed6-cba2802d4deb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.712548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63323c1-a3fc-4ccd-bed6-cba2802d4deb None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.713530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63323c1-a3fc-4ccd-bed6-cba2802d4deb None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:03.713647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63323c1-a3fc-4ccd-bed6-cba2802d4deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:03.714972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63323c1-a3fc-4ccd-bed6-cba2802d4deb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:03.726087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 181/361] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:05:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:03.727707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313b14e-27a6-4392-90ed-0330799329a2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.727994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313b14e-27a6-4392-90ed-0330799329a2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.728271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313b14e-27a6-4392-90ed-0330799329a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.740927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302688-b9b6-41c1-947a-5090bc00899b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.751235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6313b14e-27a6-4392-90ed-0330799329a2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:03.752503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6313b14e-27a6-4392-90ed-0330799329a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:03.764290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:03.791577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef61c3a-972b-4842-9fb9-ad760b7ab265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:03.793263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef61c3a-972b-4842-9fb9-ad760b7ab265 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.794015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef61c3a-972b-4842-9fb9-ad760b7ab265 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.794577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef61c3a-972b-4842-9fb9-ad760b7ab265 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:03.796258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef61c3a-972b-4842-9fb9-ad760b7ab265 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:03.798216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef61c3a-972b-4842-9fb9-ad760b7ab265 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:03.805668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 181/362] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:03 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:03.807790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef61c3a-972b-4842-9fb9-ad760b7ab265 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:03.841823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 182/363] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:03.843933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313b14e-27a6-4392-90ed-0330799329a2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:03.858189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:03.929632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef61c3a-972b-4842-9fb9-ad760b7ab265 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.961457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313b14e-27a6-4392-90ed-0330799329a2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:03.972374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8d05-62cf-444f-b170-04ea11e26167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:03.972825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8d05-62cf-444f-b170-04ea11e26167 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:03.973113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8d05-62cf-444f-b170-04ea11e26167 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:03.973391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8d05-62cf-444f-b170-04ea11e26167 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.004864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:04.005773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:04.006392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:04.007129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.011854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] RBAC: Adding query filter params (group.id=7268ecfee1e049f5a0838bd197f462b6, role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=8364b69580ec486c8b430bf6e13ce028) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:04.011854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:04.011854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:04.020402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 183/364] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:03 2022] GET /identity/v3/role_assignments?group.id=7268ecfee1e049f5a0838bd197f462b6&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=377207058e944d2a91e7afd0f3c46025 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:04.021518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.048264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:04.065227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc8d05-62cf-444f-b170-04ea11e26167 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:04.066815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc8d05-62cf-444f-b170-04ea11e26167 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:04.118019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:04.149348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4651df-de58-46ef-b117-c2d6ae2e8ff4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:04.191611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564816b7-6bbb-48f8-ab3a-2249c0fb12b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:04.192696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564816b7-6bbb-48f8-ab3a-2249c0fb12b9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:04.193036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564816b7-6bbb-48f8-ab3a-2249c0fb12b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:04.193401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564816b7-6bbb-48f8-ab3a-2249c0fb12b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.206752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564816b7-6bbb-48f8-ab3a-2249c0fb12b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-564816b7-6bbb-48f8-ab3a-2249c0fb12b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:04.212658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:04.213642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:04.214450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 184/365] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:04.225031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564816b7-6bbb-48f8-ab3a-2249c0fb12b9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.237107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 182/366] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:04.238394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8d05-62cf-444f-b170-04ea11e26167 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.347421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:04.366559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8d05-62cf-444f-b170-04ea11e26167 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:04.366969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564816b7-6bbb-48f8-ab3a-2249c0fb12b9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:04.406375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:04.407010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:04.407294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:04.407570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.408239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:04.408547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:04.411929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:04.412794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:04.418343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d97c-a398-4bca-a0dd-b656e50ec46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:04.419886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d97c-a398-4bca-a0dd-b656e50ec46f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:04.420391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d97c-a398-4bca-a0dd-b656e50ec46f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:04.421709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d97c-a398-4bca-a0dd-b656e50ec46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.423721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 185/367] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:04.425324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.438147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31d97c-a398-4bca-a0dd-b656e50ec46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-0a31d97c-a398-4bca-a0dd-b656e50ec46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:04.448899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:04.449982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 183/368] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:04.450742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d97c-a398-4bca-a0dd-b656e50ec46f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.547435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbd5d8-702d-4b8a-afc7-92aa7926a4cc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:04.580291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d97c-a398-4bca-a0dd-b656e50ec46f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:04.585825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42453e9c-6d30-472d-8ddb-525191630165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:04.586514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42453e9c-6d30-472d-8ddb-525191630165 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:04.586799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42453e9c-6d30-472d-8ddb-525191630165 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:04.587106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42453e9c-6d30-472d-8ddb-525191630165 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.588762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42453e9c-6d30-472d-8ddb-525191630165 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:04.590271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42453e9c-6d30-472d-8ddb-525191630165 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:04.592254 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 186/369] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:04.593028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42453e9c-6d30-472d-8ddb-525191630165 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.624075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34012e00-a7fb-4332-964c-bd3edbd7ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:04.625010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012e00-a7fb-4332-964c-bd3edbd7ccfc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:04.625568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012e00-a7fb-4332-964c-bd3edbd7ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:04.625857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012e00-a7fb-4332-964c-bd3edbd7ccfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.646282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:04.664719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:04.712704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42453e9c-6d30-472d-8ddb-525191630165 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:04.718957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34012e00-a7fb-4332-964c-bd3edbd7ccfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:04.720556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34012e00-a7fb-4332-964c-bd3edbd7ccfc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:04.762688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:04.763622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:04.763912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:04.764193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.764871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:04.765180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:04.767697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:04.781223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 187/370] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:04.782565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.850111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 184/371] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:04.850892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34012e00-a7fb-4332-964c-bd3edbd7ccfc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.914242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:04.915010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45740c-97bf-48db-8a99-eebe7a8a61e9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:04.947257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:04.957916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2af056-9d45-47e6-aaad-d584f10a177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:04.958564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af056-9d45-47e6-aaad-d584f10a177b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:04.958844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af056-9d45-47e6-aaad-d584f10a177b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:04.959178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2af056-9d45-47e6-aaad-d584f10a177b None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:04.960305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2af056-9d45-47e6-aaad-d584f10a177b None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:04.961762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2af056-9d45-47e6-aaad-d584f10a177b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:04.964882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 188/372] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:04.965668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2af056-9d45-47e6-aaad-d584f10a177b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:04.985259 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34012e00-a7fb-4332-964c-bd3edbd7ccfc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:05.033857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4257a09-f84f-49ec-b617-2af1f8cb7cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:05.034793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257a09-f84f-49ec-b617-2af1f8cb7cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.035126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257a09-f84f-49ec-b617-2af1f8cb7cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.035765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4257a09-f84f-49ec-b617-2af1f8cb7cb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.095973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2af056-9d45-47e6-aaad-d584f10a177b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:05.138667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4257a09-f84f-49ec-b617-2af1f8cb7cb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:05.141182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4257a09-f84f-49ec-b617-2af1f8cb7cb8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:05.145103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dffdb-f14e-4403-9d3f-58c21644ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:05.145830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dffdb-f14e-4403-9d3f-58c21644ce19 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.146113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dffdb-f14e-4403-9d3f-58c21644ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.146390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dffdb-f14e-4403-9d3f-58c21644ce19 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.147758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dffdb-f14e-4403-9d3f-58c21644ce19 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:05.149252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dffdb-f14e-4403-9d3f-58c21644ce19 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:05.152674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 189/373] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:05.153533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dffdb-f14e-4403-9d3f-58c21644ce19 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:05.203891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:05.234801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:05.286309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dffdb-f14e-4403-9d3f-58c21644ce19 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:05.293862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 185/374] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:05.295342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4257a09-f84f-49ec-b617-2af1f8cb7cb8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:05.327219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:05.327900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.328189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.328466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.329204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] RBAC: Adding query filter params (group.id=7268ecfee1e049f5a0838bd197f462b6, role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:05.329517 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:05.330956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:05.337673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 190/375] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:05 2022] GET /identity/v3/role_assignments?group.id=7268ecfee1e049f5a0838bd197f462b6&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:05.346441 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:05.426027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4257a09-f84f-49ec-b617-2af1f8cb7cb8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:05.470773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451b9f-5133-4302-9555-e37876c9c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:05.471591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451b9f-5133-4302-9555-e37876c9c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.471883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451b9f-5133-4302-9555-e37876c9c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.472164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de451b9f-5133-4302-9555-e37876c9c5d2 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.473357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de451b9f-5133-4302-9555-e37876c9c5d2 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:05.475173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de451b9f-5133-4302-9555-e37876c9c5d2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:05.477949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 186/376] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:05 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:05.483494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451b9f-5133-4302-9555-e37876c9c5d2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:05.503209 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:05.614263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de451b9f-5133-4302-9555-e37876c9c5d2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:05.633111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9c716-1164-44a2-ae9f-f774c27f7f64 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:05.660307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:05.660929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.661313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.661573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.662352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] RBAC: Adding query filter params (group.id=7268ecfee1e049f5a0838bd197f462b6, role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:05.662670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:05.665025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:05.669319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:05.674422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 187/377] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:05 2022] GET /identity/v3/role_assignments?group.id=7268ecfee1e049f5a0838bd197f462b6&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=377207058e944d2a91e7afd0f3c46025 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:05.681144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c7f0c-5f01-49d3-91aa-c2f49f858d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:05.682124 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c7f0c-5f01-49d3-91aa-c2f49f858d7e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.682345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c7f0c-5f01-49d3-91aa-c2f49f858d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.682540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c7f0c-5f01-49d3-91aa-c2f49f858d7e None admin] PATH_INFO: `/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.683755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c7f0c-5f01-49d3-91aa-c2f49f858d7e None admin] RBAC: Authorizing `identity:get_project(project_id=15e72dcb5f5c45fcb95f7b09027953b7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:05.685227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c7f0c-5f01-49d3-91aa-c2f49f858d7e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:05.686949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 191/378] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:05 2022] GET /identity/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7 => generated 344 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:05.692642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:05.788946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:05.817581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36270f-f9b9-4d7a-b0ba-4163ad24a14d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:05.857653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd022-080c-414d-8a2a-c93e7c0c88ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:05.858380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd022-080c-414d-8a2a-c93e7c0c88ee None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.858562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd022-080c-414d-8a2a-c93e7c0c88ee None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.858843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd022-080c-414d-8a2a-c93e7c0c88ee None admin] PATH_INFO: `/v3/groups/9d439b656ad943d0aad487d635bda4b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.868073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffd022-080c-414d-8a2a-c93e7c0c88ee None admin] RBAC: Authorizing `identity:get_group(group_id=9d439b656ad943d0aad487d635bda4b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:05.869627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffd022-080c-414d-8a2a-c93e7c0c88ee None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:05.871416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 188/379] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:05 2022] GET /identity/v3/groups/9d439b656ad943d0aad487d635bda4b6 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:05.877615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c7f0c-5f01-49d3-91aa-c2f49f858d7e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:05.921169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe937-55df-43d2-aa2e-25ec5118440f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.921490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe937-55df-43d2-aa2e-25ec5118440f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.921776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe937-55df-43d2-aa2e-25ec5118440f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.923492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 189/380] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:05:05.930811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b78bd8-0153-41ad-a3d3-e947bcb7c65b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:05.931137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b78bd8-0153-41ad-a3d3-e947bcb7c65b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:05.931479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b78bd8-0153-41ad-a3d3-e947bcb7c65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:05.954847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-77b78bd8-0153-41ad-a3d3-e947bcb7c65b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:05.956455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-77b78bd8-0153-41ad-a3d3-e947bcb7c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:06.045150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c7f0c-5f01-49d3-91aa-c2f49f858d7e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:06.093870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 190/381] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:06.095878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703150f4-d10b-4f12-a593-226611d92917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:06.096507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703150f4-d10b-4f12-a593-226611d92917 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:06.096792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703150f4-d10b-4f12-a593-226611d92917 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:06.097070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703150f4-d10b-4f12-a593-226611d92917 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:06.097811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703150f4-d10b-4f12-a593-226611d92917 None admin] RBAC: Adding query filter params (group.id=9d439b656ad943d0aad487d635bda4b6, role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=15e72dcb5f5c45fcb95f7b09027953b7) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:06.098126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703150f4-d10b-4f12-a593-226611d92917 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:06.107884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703150f4-d10b-4f12-a593-226611d92917 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:06.117502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 192/382] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:05 2022] GET /identity/v3/role_assignments?group.id=9d439b656ad943d0aad487d635bda4b6&scope.project.id=15e72dcb5f5c45fcb95f7b09027953b7&role.id=0f99070a6a88400199520fccd98977b6 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:06.393635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b78bd8-0153-41ad-a3d3-e947bcb7c65b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:06.508278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:06.549675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b78bd8-0153-41ad-a3d3-e947bcb7c65b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:06.586947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5245-8756-47e7-a9b6-b5a0420a5a5d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:06.587314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5245-8756-47e7-a9b6-b5a0420a5a5d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:06.587526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba5245-8756-47e7-a9b6-b5a0420a5a5d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:06.588111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a9ee5-1330-4c45-8258-97951793d550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:06.588904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a9ee5-1330-4c45-8258-97951793d550 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:06.589190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a9ee5-1330-4c45-8258-97951793d550 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:06.589467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a9ee5-1330-4c45-8258-97951793d550 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:06.590763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 193/383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:06.595241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c7407-31dc-4e67-8020-15e41d0c48a9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:06.595535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c7407-31dc-4e67-8020-15e41d0c48a9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:06.595821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c7407-31dc-4e67-8020-15e41d0c48a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:06.601055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a9ee5-1330-4c45-8258-97951793d550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-749a9ee5-1330-4c45-8258-97951793d550 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:06.607939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:06.609950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:06.611274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 191/384] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:06.614830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a9ee5-1330-4c45-8258-97951793d550 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:06.618362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ca4c7407-31dc-4e67-8020-15e41d0c48a9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:06.619773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ca4c7407-31dc-4e67-8020-15e41d0c48a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:06.735878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:06.737877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a9ee5-1330-4c45-8258-97951793d550 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:06.773144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:06.779609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:06.780225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:06.780507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:06.780785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:06.781466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:06.781772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:06.783198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:06.785633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 194/385] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:06.793009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 192/386] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:05:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:06.798260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c7407-31dc-4e67-8020-15e41d0c48a9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:06.904755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c7407-31dc-4e67-8020-15e41d0c48a9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:06.941228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e79cf-f115-4cbb-8460-1b5d66970ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:06.942183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e79cf-f115-4cbb-8460-1b5d66970ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:06.942651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e79cf-f115-4cbb-8460-1b5d66970ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:06.943133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e79cf-f115-4cbb-8460-1b5d66970ce6 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:06.944440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e79cf-f115-4cbb-8460-1b5d66970ce6 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:06.946113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e79cf-f115-4cbb-8460-1b5d66970ce6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:06.948575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 195/387] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:06 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:06.953788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:07.088553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7081485-3674-440d-a0de-93b848ba1150 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:07.127328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c7259-8e6e-4aee-bf75-f1795564d3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:07.128320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c7259-8e6e-4aee-bf75-f1795564d3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:07.128832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c7259-8e6e-4aee-bf75-f1795564d3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:07.129346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c7259-8e6e-4aee-bf75-f1795564d3f2 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:07.132743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c7259-8e6e-4aee-bf75-f1795564d3f2 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:07.134387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c7259-8e6e-4aee-bf75-f1795564d3f2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:07.136683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 193/388] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:06 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:07.142100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e79cf-f115-4cbb-8460-1b5d66970ce6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:07.219833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:07.252714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e79cf-f115-4cbb-8460-1b5d66970ce6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:07.289422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d86780-9547-4e95-9b8c-1711cdc17086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:07.290118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d86780-9547-4e95-9b8c-1711cdc17086 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:07.290408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d86780-9547-4e95-9b8c-1711cdc17086 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:07.290684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d86780-9547-4e95-9b8c-1711cdc17086 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028/groups/7268ecfee1e049f5a0838bd197f462b6/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:07.293558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d86780-9547-4e95-9b8c-1711cdc17086 None admin] RBAC: Authorizing `identity:create_grant(project_id=8364b69580ec486c8b430bf6e13ce028, group_id=7268ecfee1e049f5a0838bd197f462b6, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:07.295091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d86780-9547-4e95-9b8c-1711cdc17086 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:07.297728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c7259-8e6e-4aee-bf75-f1795564d3f2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:07.319063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 196/389] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 19:05:07 2022] PUT /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028/groups/7268ecfee1e049f5a0838bd197f462b6/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:07.397150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:07.452637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c7259-8e6e-4aee-bf75-f1795564d3f2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:07.494767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41192e-e4da-4ce9-8bce-5709bb2bf3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:07.495453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41192e-e4da-4ce9-8bce-5709bb2bf3ed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:07.495839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41192e-e4da-4ce9-8bce-5709bb2bf3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:07.496120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41192e-e4da-4ce9-8bce-5709bb2bf3ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:07.513472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41192e-e4da-4ce9-8bce-5709bb2bf3ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4c41192e-e4da-4ce9-8bce-5709bb2bf3ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:07.522881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:07.523942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:07.524715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 194/390] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:05:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:07.532234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d86780-9547-4e95-9b8c-1711cdc17086 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:07.647337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d86780-9547-4e95-9b8c-1711cdc17086 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:07.671939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:07.693032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:07.693645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:07.693923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:07.694252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:07.694928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:07.695259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:07.696625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:07.708463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 197/391] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:07.714726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41192e-e4da-4ce9-8bce-5709bb2bf3ed None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:07.827430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41192e-e4da-4ce9-8bce-5709bb2bf3ed None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:07.853164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:07.866845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66522d81-61ad-465b-845a-9d27b0e3b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:07.867583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522d81-61ad-465b-845a-9d27b0e3b417 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:07.867864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522d81-61ad-465b-845a-9d27b0e3b417 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:07.868142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66522d81-61ad-465b-845a-9d27b0e3b417 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:07.869902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66522d81-61ad-465b-845a-9d27b0e3b417 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:07.871378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66522d81-61ad-465b-845a-9d27b0e3b417 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:07.873277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 195/392] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:07 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:07.878786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:07.989301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e349afa-ed06-4cc1-86a8-7441a5353aa5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:08.025178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c968e89-d837-47bd-9dc3-b2262e560440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:08.025955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c968e89-d837-47bd-9dc3-b2262e560440 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:08.026237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c968e89-d837-47bd-9dc3-b2262e560440 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:08.026616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c968e89-d837-47bd-9dc3-b2262e560440 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:08.027795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c968e89-d837-47bd-9dc3-b2262e560440 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:08.029232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c968e89-d837-47bd-9dc3-b2262e560440 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:08.031192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 198/393] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:07 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:08.037685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66522d81-61ad-465b-845a-9d27b0e3b417 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:08.163914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66522d81-61ad-465b-845a-9d27b0e3b417 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:08.203782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b1108-4714-423e-a605-4bee721cc94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:08.204449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1108-4714-423e-a605-4bee721cc94c None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:08.204729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1108-4714-423e-a605-4bee721cc94c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:08.205007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b1108-4714-423e-a605-4bee721cc94c None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028/groups/7268ecfee1e049f5a0838bd197f462b6/roles/377207058e944d2a91e7afd0f3c46025` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:08.207208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b1108-4714-423e-a605-4bee721cc94c None admin] RBAC: Authorizing `identity:create_grant(project_id=8364b69580ec486c8b430bf6e13ce028, group_id=7268ecfee1e049f5a0838bd197f462b6, role_id=377207058e944d2a91e7afd0f3c46025)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:08.208638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b1108-4714-423e-a605-4bee721cc94c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:08.233628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 196/394] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 19:05:08 2022] PUT /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028/groups/7268ecfee1e049f5a0838bd197f462b6/roles/377207058e944d2a91e7afd0f3c46025 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:05:08.575537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf3b1b-115e-45c4-837b-de93b4329885 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:08.575924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf3b1b-115e-45c4-837b-de93b4329885 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:08.576102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf3b1b-115e-45c4-837b-de93b4329885 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:08.577758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 199/395] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:08.583526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2772a-c5d7-4ff5-868c-5fa19fde06e6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:08.583816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2772a-c5d7-4ff5-868c-5fa19fde06e6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:08.584099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2772a-c5d7-4ff5-868c-5fa19fde06e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:08.609365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e0f2772a-c5d7-4ff5-868c-5fa19fde06e6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:08.610637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e0f2772a-c5d7-4ff5-868c-5fa19fde06e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:08.665482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:08.681270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc74b1c-0687-4b0a-9338-eb5bc322ba49 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:08.681605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc74b1c-0687-4b0a-9338-eb5bc322ba49 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:08.681862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc74b1c-0687-4b0a-9338-eb5bc322ba49 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:08.683343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 200/396] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:05:08.692084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0c50-96cf-418e-8e28-39fe0fe13309 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:08.692684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0c50-96cf-418e-8e28-39fe0fe13309 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:08.693186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f0c50-96cf-418e-8e28-39fe0fe13309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:08.698131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 197/397] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:08.715716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-946f0c50-96cf-418e-8e28-39fe0fe13309 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:08.717232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-946f0c50-96cf-418e-8e28-39fe0fe13309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:08.766978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:08.799114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 201/398] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:09.103682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2772a-c5d7-4ff5-868c-5fa19fde06e6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:09.117303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f0c50-96cf-418e-8e28-39fe0fe13309 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:09.279035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2772a-c5d7-4ff5-868c-5fa19fde06e6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:09.317355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f0c50-96cf-418e-8e28-39fe0fe13309 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:09.321223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06f445-bd3f-45c7-80a2-1863ee163815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:09.321874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f445-bd3f-45c7-80a2-1863ee163815 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.322157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f445-bd3f-45c7-80a2-1863ee163815 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.322600 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06f445-bd3f-45c7-80a2-1863ee163815 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.335890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06f445-bd3f-45c7-80a2-1863ee163815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-9e06f445-bd3f-45c7-80a2-1863ee163815 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:09.342957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:09.343946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:09.345157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 198/399] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:09.345989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51b58-ce05-4648-b503-976b90edbeba None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.346231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51b58-ce05-4648-b503-976b90edbeba None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.346421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca51b58-ce05-4648-b503-976b90edbeba None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.349116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 199/400] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:09.350464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51b58-ce05-4648-b503-976b90edbeba None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:09.362414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3ad34-636d-4ea3-b8cb-0d1af2bc7562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:09.363675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3ad34-636d-4ea3-b8cb-0d1af2bc7562 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.364102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3ad34-636d-4ea3-b8cb-0d1af2bc7562 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.364519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3ad34-636d-4ea3-b8cb-0d1af2bc7562 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.379423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3ad34-636d-4ea3-b8cb-0d1af2bc7562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-04a3ad34-636d-4ea3-b8cb-0d1af2bc7562 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:09.385565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:09.386471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 202/401] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:09.392117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e9c4e-c816-4c89-8432-ecb6debb3b67 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.392819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e9c4e-c816-4c89-8432-ecb6debb3b67 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.392819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e9c4e-c816-4c89-8432-ecb6debb3b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.409978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b32e9c4e-c816-4c89-8432-ecb6debb3b67 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:09.411433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:09.412314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b32e9c4e-c816-4c89-8432-ecb6debb3b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:09.457630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:09.482101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca51b58-ce05-4648-b503-976b90edbeba None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:09.514052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 203/402] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:09.515915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e9c4e-c816-4c89-8432-ecb6debb3b67 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:09.520083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:09.520400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.520729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.521012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.521683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:09.522044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:09.523530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:09.533302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 200/403] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:09.538893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:09.647544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e9c4e-c816-4c89-8432-ecb6debb3b67 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:09.665177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb2d68-5c22-4e9b-a900-855dbc58014b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:09.667645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:09.686062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:09.686741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.687056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.687330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.688008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:09.688320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:09.689767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:09.699771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 204/404] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:09.707981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:09.714218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf3fc-0235-41f6-a9f9-f460aa74fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:09.715232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf3fc-0235-41f6-a9f9-f460aa74fe03 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.716536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf3fc-0235-41f6-a9f9-f460aa74fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.717018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bebf3fc-0235-41f6-a9f9-f460aa74fe03 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.719202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebf3fc-0235-41f6-a9f9-f460aa74fe03 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:09.723985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bebf3fc-0235-41f6-a9f9-f460aa74fe03 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:09.725820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 201/405] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:09.734235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf3fc-0235-41f6-a9f9-f460aa74fe03 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:09.774012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:09.899964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9dda-4dd1-4c37-9d40-1cbcc019f7c7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:09.908407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bebf3fc-0235-41f6-a9f9-f460aa74fe03 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:09.935297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1286f-4396-48ae-b0a2-00d5cf36629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:09.935929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1286f-4396-48ae-b0a2-00d5cf36629a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.936216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1286f-4396-48ae-b0a2-00d5cf36629a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.936490 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1286f-4396-48ae-b0a2-00d5cf36629a None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.937609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1286f-4396-48ae-b0a2-00d5cf36629a None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:09.939056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1286f-4396-48ae-b0a2-00d5cf36629a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:09.940639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 205/406] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:09.941400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1286f-4396-48ae-b0a2-00d5cf36629a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:09.948527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c62f8-caf1-4b7a-9a9a-2a390010bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:09.949178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c62f8-caf1-4b7a-9a9a-2a390010bd8b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:09.949461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c62f8-caf1-4b7a-9a9a-2a390010bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:09.949739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c62f8-caf1-4b7a-9a9a-2a390010bd8b None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:09.950887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c62f8-caf1-4b7a-9a9a-2a390010bd8b None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:09.952362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c62f8-caf1-4b7a-9a9a-2a390010bd8b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:09.954183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 202/407] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:09.954759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c62f8-caf1-4b7a-9a9a-2a390010bd8b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:10.010265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:10.045559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:10.052405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1286f-4396-48ae-b0a2-00d5cf36629a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:10.070520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c62f8-caf1-4b7a-9a9a-2a390010bd8b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:10.091780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095856c7-f357-4cb6-af6f-278a7b27cbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:10.092433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095856c7-f357-4cb6-af6f-278a7b27cbff None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.092715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095856c7-f357-4cb6-af6f-278a7b27cbff None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.092992 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095856c7-f357-4cb6-af6f-278a7b27cbff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.105488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095856c7-f357-4cb6-af6f-278a7b27cbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-095856c7-f357-4cb6-af6f-278a7b27cbff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:10.111216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:10.112109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:10.112886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 206/408] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:10.113517 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095856c7-f357-4cb6-af6f-278a7b27cbff None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:10.121872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818e096-030d-4856-934f-58807f4ab118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:10.123218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818e096-030d-4856-934f-58807f4ab118 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.123690 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818e096-030d-4856-934f-58807f4ab118 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.124145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818e096-030d-4856-934f-58807f4ab118 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.125478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818e096-030d-4856-934f-58807f4ab118 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:10.127267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818e096-030d-4856-934f-58807f4ab118 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:10.129054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 203/409] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:09 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:10.130053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818e096-030d-4856-934f-58807f4ab118 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:10.237790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095856c7-f357-4cb6-af6f-278a7b27cbff None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:10.260429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818e096-030d-4856-934f-58807f4ab118 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:10.267927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:10.275297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b7d8-c72f-4932-a019-614fc52599ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:10.276110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b7d8-c72f-4932-a019-614fc52599ad None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.276389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b7d8-c72f-4932-a019-614fc52599ad None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.276671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77b7d8-c72f-4932-a019-614fc52599ad None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/groups/7268ecfee1e049f5a0838bd197f462b6/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.278729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77b7d8-c72f-4932-a019-614fc52599ad None admin] RBAC: Authorizing `identity:create_grant(project_id=77531e28ab5e4a9f970bf1dea34d9442, group_id=7268ecfee1e049f5a0838bd197f462b6, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:10.280215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77b7d8-c72f-4932-a019-614fc52599ad None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:10.298443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe50e6-b74d-413b-9d09-ad7573317095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:10.299567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe50e6-b74d-413b-9d09-ad7573317095 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.300189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe50e6-b74d-413b-9d09-ad7573317095 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.300665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe50e6-b74d-413b-9d09-ad7573317095 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.301561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe50e6-b74d-413b-9d09-ad7573317095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:10.302101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe50e6-b74d-413b-9d09-ad7573317095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:10.303088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 207/410] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 19:05:10 2022] PUT /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/groups/7268ecfee1e049f5a0838bd197f462b6/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:10.304041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe50e6-b74d-413b-9d09-ad7573317095 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:10.304151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b7d8-c72f-4932-a019-614fc52599ad None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:10.321443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 204/411] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:10.323930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea612d-2c37-4d03-b76d-2f8428214be2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.324554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea612d-2c37-4d03-b76d-2f8428214be2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.325043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea612d-2c37-4d03-b76d-2f8428214be2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.326975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 205/412] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:10.328104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea612d-2c37-4d03-b76d-2f8428214be2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:10.333847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:10.459674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77b7d8-c72f-4932-a019-614fc52599ad None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:10.475149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea612d-2c37-4d03-b76d-2f8428214be2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:10.509586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26693f-ffea-4e64-b289-7c938decb048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:10.511032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26693f-ffea-4e64-b289-7c938decb048 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.511480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26693f-ffea-4e64-b289-7c938decb048 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.511899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26693f-ffea-4e64-b289-7c938decb048 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/groups/7268ecfee1e049f5a0838bd197f462b6/roles/377207058e944d2a91e7afd0f3c46025` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.515113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26693f-ffea-4e64-b289-7c938decb048 None admin] RBAC: Authorizing `identity:create_grant(project_id=77531e28ab5e4a9f970bf1dea34d9442, group_id=7268ecfee1e049f5a0838bd197f462b6, role_id=377207058e944d2a91e7afd0f3c46025)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:10.516710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26693f-ffea-4e64-b289-7c938decb048 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:10.518180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1073319-6352-49dd-a059-d11c3e1c283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:10.518967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073319-6352-49dd-a059-d11c3e1c283a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.519614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073319-6352-49dd-a059-d11c3e1c283a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.519989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1073319-6352-49dd-a059-d11c3e1c283a None admin] PATH_INFO: `/v3/groups/9d439b656ad943d0aad487d635bda4b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.521846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1073319-6352-49dd-a059-d11c3e1c283a None admin] RBAC: Authorizing `identity:get_group(group_id=9d439b656ad943d0aad487d635bda4b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:10.523884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1073319-6352-49dd-a059-d11c3e1c283a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:10.526484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 206/413] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:10 2022] GET /identity/v3/groups/9d439b656ad943d0aad487d635bda4b6 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:10.531304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdf100-6e23-4f89-a6f1-d6b64eefe60c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.531304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdf100-6e23-4f89-a6f1-d6b64eefe60c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.531304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdf100-6e23-4f89-a6f1-d6b64eefe60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.537886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 208/414] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 19:05:10 2022] PUT /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442/groups/7268ecfee1e049f5a0838bd197f462b6/roles/377207058e944d2a91e7afd0f3c46025 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:10.538928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26693f-ffea-4e64-b289-7c938decb048 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:10.559125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-13fdf100-6e23-4f89-a6f1-d6b64eefe60c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:10.560892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-13fdf100-6e23-4f89-a6f1-d6b64eefe60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:10.618505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:10.633945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:10.661546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26693f-ffea-4e64-b289-7c938decb048 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:10.702036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23120fdb-ea7f-4bb9-8639-fc0b0e69ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:10.703087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23120fdb-ea7f-4bb9-8639-fc0b0e69ae5f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.703569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23120fdb-ea7f-4bb9-8639-fc0b0e69ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.704038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23120fdb-ea7f-4bb9-8639-fc0b0e69ae5f None admin] PATH_INFO: `/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.705483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23120fdb-ea7f-4bb9-8639-fc0b0e69ae5f None admin] RBAC: Authorizing `identity:get_project(project_id=15e72dcb5f5c45fcb95f7b09027953b7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:10.707176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23120fdb-ea7f-4bb9-8639-fc0b0e69ae5f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:10.709029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 209/415] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:10 2022] GET /identity/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:10.714511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 207/416] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:10.715961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23120fdb-ea7f-4bb9-8639-fc0b0e69ae5f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:10.832543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23120fdb-ea7f-4bb9-8639-fc0b0e69ae5f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:10.870942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da885836-4831-42e4-9c1a-21f519d30e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:10.871650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885836-4831-42e4-9c1a-21f519d30e10 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:10.871936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885836-4831-42e4-9c1a-21f519d30e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:10.872215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da885836-4831-42e4-9c1a-21f519d30e10 None admin] PATH_INFO: `/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7/groups/9d439b656ad943d0aad487d635bda4b6/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:10.874146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da885836-4831-42e4-9c1a-21f519d30e10 None admin] RBAC: Authorizing `identity:create_grant(project_id=15e72dcb5f5c45fcb95f7b09027953b7, group_id=9d439b656ad943d0aad487d635bda4b6, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:10.875634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da885836-4831-42e4-9c1a-21f519d30e10 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:10.893195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 210/417] 10.222.0.20 () {58 vars in 1442 bytes} [Fri Sep 16 19:05:10 2022] PUT /identity/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7/groups/9d439b656ad943d0aad487d635bda4b6/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:11.085498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc1409-e22c-4dc0-b8ae-e763b253b5ef None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:11.086120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc1409-e22c-4dc0-b8ae-e763b253b5ef None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:11.086633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc1409-e22c-4dc0-b8ae-e763b253b5ef None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:11.088614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 208/418] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:11.094952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc1409-e22c-4dc0-b8ae-e763b253b5ef None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:11.095173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972a66-de8e-41bf-a4aa-cc4163092bbc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:11.095698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972a66-de8e-41bf-a4aa-cc4163092bbc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:11.096262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04972a66-de8e-41bf-a4aa-cc4163092bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:11.109043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:11.125393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-04972a66-de8e-41bf-a4aa-cc4163092bbc None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:11.127246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-04972a66-de8e-41bf-a4aa-cc4163092bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:11.213700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 211/419] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:11.247677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc1409-e22c-4dc0-b8ae-e763b253b5ef None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:11.302581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b001d-5343-40bc-8b45-b28e74b28a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:11.303512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b001d-5343-40bc-8b45-b28e74b28a47 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:11.303962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b001d-5343-40bc-8b45-b28e74b28a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:11.304378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b001d-5343-40bc-8b45-b28e74b28a47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:11.324698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b001d-5343-40bc-8b45-b28e74b28a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-710b001d-5343-40bc-8b45-b28e74b28a47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:11.329875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:11.331039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:11.332037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:11.334249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 209/420] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:11.340385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04972a66-de8e-41bf-a4aa-cc4163092bbc None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:11.491386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04972a66-de8e-41bf-a4aa-cc4163092bbc None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:11.536366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:11.536980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:11.537262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:11.537540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:11.538212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] RBAC: Adding query filter params (name=member) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:11.538520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:11.539916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:11.541563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:11.554879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 212/421] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:05:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:11.561239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b001d-5343-40bc-8b45-b28e74b28a47 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:11.566073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:11.648610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:11.685938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eff999-980c-4b4f-a2f3-fceff4f1d5db None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:11.749280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105171e-98a5-4664-8aa7-9cceba3ac1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:11.749963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105171e-98a5-4664-8aa7-9cceba3ac1bc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:11.750248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105171e-98a5-4664-8aa7-9cceba3ac1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:11.750525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105171e-98a5-4664-8aa7-9cceba3ac1bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:11.770345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105171e-98a5-4664-8aa7-9cceba3ac1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:11.771534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b001d-5343-40bc-8b45-b28e74b28a47 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b105171e-98a5-4664-8aa7-9cceba3ac1bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:11.775845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:11.776703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:11.777485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 213/422] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:05:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:11.785095 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105171e-98a5-4664-8aa7-9cceba3ac1bc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:11.836044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf95e65-d1f1-4c5a-8a5b-7f4adc4e7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:11.837164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf95e65-d1f1-4c5a-8a5b-7f4adc4e7228 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:11.838872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf95e65-d1f1-4c5a-8a5b-7f4adc4e7228 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:11.839369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf95e65-d1f1-4c5a-8a5b-7f4adc4e7228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:11.884185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:11.929604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf95e65-d1f1-4c5a-8a5b-7f4adc4e7228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:11.931471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf95e65-d1f1-4c5a-8a5b-7f4adc4e7228 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:11.960501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:12.021721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105171e-98a5-4664-8aa7-9cceba3ac1bc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:12.041117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 210/423] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:12.047596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf95e65-d1f1-4c5a-8a5b-7f4adc4e7228 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:12.096116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:12.097161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.097669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.099538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.100511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:12.101021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:12.103456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:12.120107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 214/424] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:12.144398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:12.242916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf95e65-d1f1-4c5a-8a5b-7f4adc4e7228 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:12.272243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:12.295602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9528-6e20-43e3-a5a2-0093d241ae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:12.296317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9528-6e20-43e3-a5a2-0093d241ae10 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.296601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9528-6e20-43e3-a5a2-0093d241ae10 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.296876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f9528-6e20-43e3-a5a2-0093d241ae10 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.298981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f9528-6e20-43e3-a5a2-0093d241ae10 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:12.300551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f9528-6e20-43e3-a5a2-0093d241ae10 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:12.302652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 211/425] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:12 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:12.319282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9528-6e20-43e3-a5a2-0093d241ae10 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:12.323993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86996fc-5d15-4531-ac4c-01ed665f6405 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:12.367396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:12.386250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5fed-8b24-41d8-8d58-fbb3c223b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:12.386878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5fed-8b24-41d8-8d58-fbb3c223b0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.387195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5fed-8b24-41d8-8d58-fbb3c223b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.387482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d5fed-8b24-41d8-8d58-fbb3c223b0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.444079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f9528-6e20-43e3-a5a2-0093d241ae10 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:12.499480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d5fed-8b24-41d8-8d58-fbb3c223b0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:12.499792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241d79b-3c3c-4739-94f7-2196066856c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:12.500351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d79b-3c3c-4739-94f7-2196066856c6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.500631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d79b-3c3c-4739-94f7-2196066856c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.500874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d5fed-8b24-41d8-8d58-fbb3c223b0e6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:12.500972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241d79b-3c3c-4739-94f7-2196066856c6 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.502057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241d79b-3c3c-4739-94f7-2196066856c6 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:12.503511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241d79b-3c3c-4739-94f7-2196066856c6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:12.505385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 212/426] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:12 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:12.523492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241d79b-3c3c-4739-94f7-2196066856c6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:12.596564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:12.616804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 215/427] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:05:12.618067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5fed-8b24-41d8-8d58-fbb3c223b0e6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:12.641576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241d79b-3c3c-4739-94f7-2196066856c6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:12.667358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:12.690495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9f3b9-f3aa-41a3-b9fa-4173d591976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:12.691141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f3b9-f3aa-41a3-b9fa-4173d591976a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.691483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f3b9-f3aa-41a3-b9fa-4173d591976a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.691762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9f3b9-f3aa-41a3-b9fa-4173d591976a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.692491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9f3b9-f3aa-41a3-b9fa-4173d591976a None admin] RBAC: Adding query filter params (group.id=7268ecfee1e049f5a0838bd197f462b6, role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=8364b69580ec486c8b430bf6e13ce028) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:12.692808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9f3b9-f3aa-41a3-b9fa-4173d591976a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:12.694298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9f3b9-f3aa-41a3-b9fa-4173d591976a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:12.714837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 213/428] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:12 2022] GET /identity/v3/role_assignments?group.id=7268ecfee1e049f5a0838bd197f462b6&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:12.717702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52232393-0f83-4f47-b9dd-215e2d297398 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.717991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52232393-0f83-4f47-b9dd-215e2d297398 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.718268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52232393-0f83-4f47-b9dd-215e2d297398 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.719844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 214/429] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:12.730184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520ba5-ae47-4162-9b6e-7ebb96946e65 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.730500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520ba5-ae47-4162-9b6e-7ebb96946e65 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.730732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520ba5-ae47-4162-9b6e-7ebb96946e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.769286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d5fed-8b24-41d8-8d58-fbb3c223b0e6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:12.772895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2e520ba5-ae47-4162-9b6e-7ebb96946e65 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:12.773561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2e520ba5-ae47-4162-9b6e-7ebb96946e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:12.808835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48523-34c9-4281-b056-291704e6d402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:12.809861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48523-34c9-4281-b056-291704e6d402 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.810346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48523-34c9-4281-b056-291704e6d402 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.810824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48523-34c9-4281-b056-291704e6d402 None admin] PATH_INFO: `/v3/projects/8364b69580ec486c8b430bf6e13ce028` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.812334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d48523-34c9-4281-b056-291704e6d402 None admin] RBAC: Authorizing `identity:get_project(project_id=8364b69580ec486c8b430bf6e13ce028)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:12.814033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d48523-34c9-4281-b056-291704e6d402 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:12.820686 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 216/430] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:12 2022] GET /identity/v3/projects/8364b69580ec486c8b430bf6e13ce028 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:12.822748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48523-34c9-4281-b056-291704e6d402 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:12.921369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 215/431] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:12.945707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:12.955188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48523-34c9-4281-b056-291704e6d402 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:12.995379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791241f-caec-4f0a-b7e5-e770e6f20d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:12.996390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791241f-caec-4f0a-b7e5-e770e6f20d2c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:12.996882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791241f-caec-4f0a-b7e5-e770e6f20d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:12.997370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791241f-caec-4f0a-b7e5-e770e6f20d2c None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:12.998709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791241f-caec-4f0a-b7e5-e770e6f20d2c None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:13.000438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5791241f-caec-4f0a-b7e5-e770e6f20d2c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:13.007062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 217/432] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:12 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:13.008702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e520ba5-ae47-4162-9b6e-7ebb96946e65 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:13.071869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:13.127533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e520ba5-ae47-4162-9b6e-7ebb96946e65 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:13.168795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:13.169766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:13.170252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:13.170823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:13.171801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] RBAC: Adding query filter params (group.id=7268ecfee1e049f5a0838bd197f462b6, role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=8364b69580ec486c8b430bf6e13ce028) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:13.172315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:13.173964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:13.183190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 216/433] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:13 2022] GET /identity/v3/role_assignments?group.id=7268ecfee1e049f5a0838bd197f462b6&scope.project.id=8364b69580ec486c8b430bf6e13ce028&role.id=377207058e944d2a91e7afd0f3c46025 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:13.236399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791241f-caec-4f0a-b7e5-e770e6f20d2c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:13.367315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791241f-caec-4f0a-b7e5-e770e6f20d2c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:13.406639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddeb72-6310-4f88-b273-65fc766e376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:13.408102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddeb72-6310-4f88-b273-65fc766e376a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:13.408589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddeb72-6310-4f88-b273-65fc766e376a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:13.409087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddeb72-6310-4f88-b273-65fc766e376a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:13.420858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddeb72-6310-4f88-b273-65fc766e376a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d0ddeb72-6310-4f88-b273-65fc766e376a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:13.426007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:13.426879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 19:05:13.427725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:13.428881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 218/434] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:13.435115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:13.472846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf47d1-01b8-4795-b019-81103406396b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:13.473126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf47d1-01b8-4795-b019-81103406396b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:13.473402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf47d1-01b8-4795-b019-81103406396b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:13.475199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 219/435] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:13.481909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e895-981e-468b-a90e-e771a1ea2198 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:13.482193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e895-981e-468b-a90e-e771a1ea2198 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:13.482472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886e895-981e-468b-a90e-e771a1ea2198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:13.510166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8886e895-981e-468b-a90e-e771a1ea2198 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:13.511792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8886e895-981e-468b-a90e-e771a1ea2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:13.526509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:13.567591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62368b-3746-44db-8cb5-8034ab1a99f2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:13.590313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:13.603082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 220/436] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:13.607329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1ff8-3420-4723-8559-ca002ab7a8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:13.608242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1ff8-3420-4723-8559-ca002ab7a8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:13.608531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1ff8-3420-4723-8559-ca002ab7a8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:13.608811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1ff8-3420-4723-8559-ca002ab7a8e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:13.609488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1ff8-3420-4723-8559-ca002ab7a8e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:13.609795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1ff8-3420-4723-8559-ca002ab7a8e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:13.613112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1ff8-3420-4723-8559-ca002ab7a8e7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:13.623031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 217/437] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:05:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:13.629001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886e895-981e-468b-a90e-e771a1ea2198 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:13.639643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6e60-668e-47e5-93b8-db24e6dda444 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:13.640155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6e60-668e-47e5-93b8-db24e6dda444 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:13.640434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e6e60-668e-47e5-93b8-db24e6dda444 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:13.641912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 218/438] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:13.647301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ffa17-0c76-47d0-818e-07902dac8c5e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:13.647587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ffa17-0c76-47d0-818e-07902dac8c5e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:13.648030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ffa17-0c76-47d0-818e-07902dac8c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:13.668041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-483ffa17-0c76-47d0-818e-07902dac8c5e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:13.669745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-483ffa17-0c76-47d0-818e-07902dac8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:13.754727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 219/439] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:13.764381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886e895-981e-468b-a90e-e771a1ea2198 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:13.800107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d517b4-ece4-4460-8030-e5c02ffe5766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:13.800788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d517b4-ece4-4460-8030-e5c02ffe5766 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:13.801076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d517b4-ece4-4460-8030-e5c02ffe5766 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:13.801864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d517b4-ece4-4460-8030-e5c02ffe5766 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:13.816067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:13.876531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d517b4-ece4-4460-8030-e5c02ffe5766 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:13.878037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d517b4-ece4-4460-8030-e5c02ffe5766 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:13.888259 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ffa17-0c76-47d0-818e-07902dac8c5e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:13.987021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 221/440] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:13.992500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d517b4-ece4-4460-8030-e5c02ffe5766 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.000112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ffa17-0c76-47d0-818e-07902dac8c5e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.014486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.036550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7465-a8b0-4cd9-affc-a05d51e642ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.037184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7465-a8b0-4cd9-affc-a05d51e642ab None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.037465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7465-a8b0-4cd9-affc-a05d51e642ab None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.037739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7465-a8b0-4cd9-affc-a05d51e642ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.039827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.049781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7465-a8b0-4cd9-affc-a05d51e642ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-289f7465-a8b0-4cd9-affc-a05d51e642ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:14.054880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:14.055814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:14.057182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 220/441] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:05:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:14.057857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7465-a8b0-4cd9-affc-a05d51e642ab None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.099268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d517b4-ece4-4460-8030-e5c02ffe5766 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18db0b-533d-416d-9cd8-89b2ed64b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.133998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18db0b-533d-416d-9cd8-89b2ed64b738 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.134280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18db0b-533d-416d-9cd8-89b2ed64b738 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.134553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18db0b-533d-416d-9cd8-89b2ed64b738 None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.135973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18db0b-533d-416d-9cd8-89b2ed64b738 None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:14.137409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18db0b-533d-416d-9cd8-89b2ed64b738 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:14.143410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 222/442] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:13 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:14.143410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18db0b-533d-416d-9cd8-89b2ed64b738 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.160549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7465-a8b0-4cd9-affc-a05d51e642ab None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.194787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749a5b-e102-49b7-b269-128dd15aeaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.195452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749a5b-e102-49b7-b269-128dd15aeaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.195736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749a5b-e102-49b7-b269-128dd15aeaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.196019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b749a5b-e102-49b7-b269-128dd15aeaa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.206044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b749a5b-e102-49b7-b269-128dd15aeaa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-1b749a5b-e102-49b7-b269-128dd15aeaa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:14.210903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:14.211918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:14.212695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 221/443] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:14.213330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749a5b-e102-49b7-b269-128dd15aeaa9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.237156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18db0b-533d-416d-9cd8-89b2ed64b738 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.245930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.250974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.272794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.273391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.273672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.273944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.274600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:14.274901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:14.276832 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:14.284721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 223/444] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:14.286426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.316059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b749a5b-e102-49b7-b269-128dd15aeaa9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.351219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27334389-2bd7-4c4f-b77b-a29354beebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.352206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27334389-2bd7-4c4f-b77b-a29354beebc0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.352382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27334389-2bd7-4c4f-b77b-a29354beebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.352656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27334389-2bd7-4c4f-b77b-a29354beebc0 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.354389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27334389-2bd7-4c4f-b77b-a29354beebc0 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:14.355877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27334389-2bd7-4c4f-b77b-a29354beebc0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:14.357451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 222/445] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:14.358213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27334389-2bd7-4c4f-b77b-a29354beebc0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.388706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b0314-b7db-4ab2-93dd-c0d37f4ce329 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.424066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.424685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.424931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.425202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.425857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:14.426157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:14.427568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:14.437162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 224/446] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:14.437430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.460122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.464138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27334389-2bd7-4c4f-b77b-a29354beebc0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.473229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.500675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76439c43-a12b-4381-ba7e-3638d8c7a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.501564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439c43-a12b-4381-ba7e-3638d8c7a208 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.501846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439c43-a12b-4381-ba7e-3638d8c7a208 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.502121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439c43-a12b-4381-ba7e-3638d8c7a208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.537011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6967b9e-8ce9-49f7-9f55-9ac1e4e059b1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.567699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76439c43-a12b-4381-ba7e-3638d8c7a208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:14.569275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76439c43-a12b-4381-ba7e-3638d8c7a208 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:14.570245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.570849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.571200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.571473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.572330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] RBAC: Adding query filter params (group.id=7268ecfee1e049f5a0838bd197f462b6, role.id=f686c7083ea64f748bfab4a77dd732e2, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:14.572646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:14.574058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:14.580226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 225/447] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/role_assignments?group.id=7268ecfee1e049f5a0838bd197f462b6&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=f686c7083ea64f748bfab4a77dd732e2 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:14.580996 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.680499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.689535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 223/448] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:14.690920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76439c43-a12b-4381-ba7e-3638d8c7a208 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.704679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.707749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a82f9f-b34b-4a62-851e-fe2fa49f1ef3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.750484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edd39e-01ac-4e9d-828c-bd56f158817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.751281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edd39e-01ac-4e9d-828c-bd56f158817d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.751421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edd39e-01ac-4e9d-828c-bd56f158817d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.751697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edd39e-01ac-4e9d-828c-bd56f158817d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.805758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76439c43-a12b-4381-ba7e-3638d8c7a208 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:14.832148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edd39e-01ac-4e9d-828c-bd56f158817d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:14.833633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edd39e-01ac-4e9d-828c-bd56f158817d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:14.847738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab613d1-53a4-4c05-9120-733bf66c1a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:14.848383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab613d1-53a4-4c05-9120-733bf66c1a1d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:14.848664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab613d1-53a4-4c05-9120-733bf66c1a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:14.849050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab613d1-53a4-4c05-9120-733bf66c1a1d None admin] PATH_INFO: `/v3/projects/77531e28ab5e4a9f970bf1dea34d9442` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:14.850060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab613d1-53a4-4c05-9120-733bf66c1a1d None admin] RBAC: Authorizing `identity:get_project(project_id=77531e28ab5e4a9f970bf1dea34d9442)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:14.852078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab613d1-53a4-4c05-9120-733bf66c1a1d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:14.859033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 224/449] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/projects/77531e28ab5e4a9f970bf1dea34d9442 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:14.859772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab613d1-53a4-4c05-9120-733bf66c1a1d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.934159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.951690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:14.959083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 226/450] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:14.960961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edd39e-01ac-4e9d-828c-bd56f158817d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:14.974336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab613d1-53a4-4c05-9120-733bf66c1a1d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:15.010340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070115d-cc38-4eb6-9b3a-4475ea57c322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:15.010969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070115d-cc38-4eb6-9b3a-4475ea57c322 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:15.011288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070115d-cc38-4eb6-9b3a-4475ea57c322 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:15.011615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070115d-cc38-4eb6-9b3a-4475ea57c322 None admin] PATH_INFO: `/v3/groups/7268ecfee1e049f5a0838bd197f462b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:15.012718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070115d-cc38-4eb6-9b3a-4475ea57c322 None admin] RBAC: Authorizing `identity:get_group(group_id=7268ecfee1e049f5a0838bd197f462b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:15.014149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070115d-cc38-4eb6-9b3a-4475ea57c322 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:15.015739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 225/451] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/groups/7268ecfee1e049f5a0838bd197f462b6 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:15.021538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070115d-cc38-4eb6-9b3a-4475ea57c322 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:15.064265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edd39e-01ac-4e9d-828c-bd56f158817d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:15.098081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe80a-831e-4a47-aa46-fed7aaa1b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:15.098707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe80a-831e-4a47-aa46-fed7aaa1b6de None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:15.099017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe80a-831e-4a47-aa46-fed7aaa1b6de None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:15.099296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe80a-831e-4a47-aa46-fed7aaa1b6de None admin] PATH_INFO: `/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:15.100413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe80a-831e-4a47-aa46-fed7aaa1b6de None admin] RBAC: Authorizing `identity:get_project(project_id=15e72dcb5f5c45fcb95f7b09027953b7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:15.102160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe80a-831e-4a47-aa46-fed7aaa1b6de None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:15.104394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 227/452] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:05:14 2022] GET /identity/v3/projects/15e72dcb5f5c45fcb95f7b09027953b7 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:15.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe80a-831e-4a47-aa46-fed7aaa1b6de None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:15.124408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070115d-cc38-4eb6-9b3a-4475ea57c322 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:15.157749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:15.158341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:15.158618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:15.158890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:15.159637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] RBAC: Adding query filter params (group.id=7268ecfee1e049f5a0838bd197f462b6, role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=77531e28ab5e4a9f970bf1dea34d9442) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:15.159941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:15.161379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:15.164109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:15.168239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 226/453] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:15 2022] GET /identity/v3/role_assignments?group.id=7268ecfee1e049f5a0838bd197f462b6&scope.project.id=77531e28ab5e4a9f970bf1dea34d9442&role.id=377207058e944d2a91e7afd0f3c46025 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:15.175232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:15.212428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe80a-831e-4a47-aa46-fed7aaa1b6de None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:15.249693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfce7e-9966-4e1e-95e3-20ed70626218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:15.250325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfce7e-9966-4e1e-95e3-20ed70626218 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:15.250605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfce7e-9966-4e1e-95e3-20ed70626218 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:15.250877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfce7e-9966-4e1e-95e3-20ed70626218 None admin] PATH_INFO: `/v3/groups/9d439b656ad943d0aad487d635bda4b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:15.252041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfce7e-9966-4e1e-95e3-20ed70626218 None admin] RBAC: Authorizing `identity:get_group(group_id=9d439b656ad943d0aad487d635bda4b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:15.253528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfce7e-9966-4e1e-95e3-20ed70626218 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:15.255167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 228/454] 10.222.0.20 () {56 vars in 1180 bytes} [Fri Sep 16 19:05:15 2022] GET /identity/v3/groups/9d439b656ad943d0aad487d635bda4b6 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:15.262276 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:15.368216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26cb40-6387-422c-aff3-e15b422df3b1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:15.404079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17bcfd-c42d-4d35-8cb8-d889996b162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:15.404763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17bcfd-c42d-4d35-8cb8-d889996b162b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:15.405098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17bcfd-c42d-4d35-8cb8-d889996b162b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:15.405425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17bcfd-c42d-4d35-8cb8-d889996b162b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:15.406311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17bcfd-c42d-4d35-8cb8-d889996b162b None admin] RBAC: Adding query filter params (group.id=9d439b656ad943d0aad487d635bda4b6, role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=15e72dcb5f5c45fcb95f7b09027953b7) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:15.406783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17bcfd-c42d-4d35-8cb8-d889996b162b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:15.409232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17bcfd-c42d-4d35-8cb8-d889996b162b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:15.418522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 227/455] 10.222.0.20 () {56 vars in 1376 bytes} [Fri Sep 16 19:05:15 2022] GET /identity/v3/role_assignments?group.id=9d439b656ad943d0aad487d635bda4b6&scope.project.id=15e72dcb5f5c45fcb95f7b09027953b7&role.id=0f99070a6a88400199520fccd98977b6 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:18.073648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55818-f475-465f-a884-4e55873cbe10 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.074554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55818-f475-465f-a884-4e55873cbe10 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.074970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf55818-f475-465f-a884-4e55873cbe10 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.076701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 229/456] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:18.082328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96311b-091d-4990-9919-0854fe73331f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.083203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96311b-091d-4990-9919-0854fe73331f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.083716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96311b-091d-4990-9919-0854fe73331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.112010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-aa96311b-091d-4990-9919-0854fe73331f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:18.113573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-aa96311b-091d-4990-9919-0854fe73331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:18.198187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:18.208079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 228/457] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:18.319323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71424c0-02a8-44bb-ba92-efe758da7cad None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.320307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71424c0-02a8-44bb-ba92-efe758da7cad None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.321077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71424c0-02a8-44bb-ba92-efe758da7cad None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.324379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 230/458] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:18.330738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cef1a-5aa9-40d7-a112-fcc1f8891eff None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.331274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cef1a-5aa9-40d7-a112-fcc1f8891eff None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.331752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cef1a-5aa9-40d7-a112-fcc1f8891eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.359973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-466cef1a-5aa9-40d7-a112-fcc1f8891eff None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:18.361435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-466cef1a-5aa9-40d7-a112-fcc1f8891eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:18.461477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 229/459] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:18.596698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71424c0-02a8-44bb-ba92-efe758da7cad None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:18.676844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb6cb-fa2e-4ca1-86a2-65ece125f56b None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.676844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb6cb-fa2e-4ca1-86a2-65ece125f56b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.676844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fb6cb-fa2e-4ca1-86a2-65ece125f56b None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.677424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 230/460] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:05:18.683202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f4983-9905-47d8-b6a5-78de2b1904df None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.683659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f4983-9905-47d8-b6a5-78de2b1904df None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.684100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f4983-9905-47d8-b6a5-78de2b1904df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.728088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ec9f4983-9905-47d8-b6a5-78de2b1904df None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:18.730009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ec9f4983-9905-47d8-b6a5-78de2b1904df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:18.730564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71424c0-02a8-44bb-ba92-efe758da7cad None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:18.771450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:18.772719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.773146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.773557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.778401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:18.787657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:18.789610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:18.803488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 231/461] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:18.805068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7d07-2b99-4d37-b87b-852c93949c41 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.805558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7d07-2b99-4d37-b87b-852c93949c41 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.806055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7d07-2b99-4d37-b87b-852c93949c41 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:18.807470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:18.808518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:18.809443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:18.809443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:18.809443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:18.809443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 231/462] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:18.809662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:18.811088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 232/463] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:18.814087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7d07-2b99-4d37-b87b-852c93949c41 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:18.884203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:18.921241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb220948-7922-4647-8a29-3cbd24f874e7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:18.945224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7d07-2b99-4d37-b87b-852c93949c41 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:18.966423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c77d-398b-49ed-afb9-2c638859d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:18.967071 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c77d-398b-49ed-afb9-2c638859d184 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.967355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c77d-398b-49ed-afb9-2c638859d184 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.967629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c77d-398b-49ed-afb9-2c638859d184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.983706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c77d-398b-49ed-afb9-2c638859d184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:18.985460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5c77d-398b-49ed-afb9-2c638859d184 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:18.986542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:18.987538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:18.988170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:18.988671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:18.989564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:18.990070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:18.991739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e0e5c77d-398b-49ed-afb9-2c638859d184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:19.002228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:19.003164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:19.004084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:19.004084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:19.004084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:19.004084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 232/464] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:19.004836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021c322-7852-4392-8123-d74345104f5d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.005119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021c322-7852-4392-8123-d74345104f5d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.005400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021c322-7852-4392-8123-d74345104f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.008182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 233/465] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:19.009312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:19.028484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f021c322-7852-4392-8123-d74345104f5d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:19.029951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f021c322-7852-4392-8123-d74345104f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:19.076219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:19.117079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 233/466] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:19.117918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021c322-7852-4392-8123-d74345104f5d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:19.125773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617aaee-52ec-4056-a40e-a1090eb7aac1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:19.142244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:19.166474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:19.167408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.167793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.168174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.168982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:19.169407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:19.171027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:19.185256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 234/467] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:19.186308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:19.236010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021c322-7852-4392-8123-d74345104f5d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:19.278042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c565764-b950-4b68-b33d-0c28912b5d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:19.278940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565764-b950-4b68-b33d-0c28912b5d50 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.279338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565764-b950-4b68-b33d-0c28912b5d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.279711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565764-b950-4b68-b33d-0c28912b5d50 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.280504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c565764-b950-4b68-b33d-0c28912b5d50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:19.282039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c565764-b950-4b68-b33d-0c28912b5d50 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:19.304996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2fb8d-be51-48c1-a53a-1f5b0649e29f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:19.310455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 234/468] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:05:19 2022] POST /identity/v3/users => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:19.311500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c565764-b950-4b68-b33d-0c28912b5d50 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:19.351349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:19.371246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:19.372090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.372539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.372920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.390215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:19.392972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:19.434334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:19.435318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:19.436161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:19.436161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:19.436161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:19.439340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 235/469] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:19.440606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:19.486334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:19.499193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c565764-b950-4b68-b33d-0c28912b5d50 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:19.543851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03afb4c-0283-4aff-8845-b282892be4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:19.544564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afb4c-0283-4aff-8845-b282892be4d9 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.545033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afb4c-0283-4aff-8845-b282892be4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.545309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03afb4c-0283-4aff-8845-b282892be4d9 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.546813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03afb4c-0283-4aff-8845-b282892be4d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:19.548300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03afb4c-0283-4aff-8845-b282892be4d9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:19.577764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 235/470] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:05:19 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:19.578691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03afb4c-0283-4aff-8845-b282892be4d9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:19.582085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b9c52-1b7e-4076-a6fe-9c756ca30725 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:19.629126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19893a3-06cd-46ce-b163-94608ace0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:19.630749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19893a3-06cd-46ce-b163-94608ace0d98 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.631087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19893a3-06cd-46ce-b163-94608ace0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.631410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19893a3-06cd-46ce-b163-94608ace0d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.646042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19893a3-06cd-46ce-b163-94608ace0d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:19.647491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19893a3-06cd-46ce-b163-94608ace0d98 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d19893a3-06cd-46ce-b163-94608ace0d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:19.664154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:19.665108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:19.666250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:19.666250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:19.666250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:19.668616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 236/471] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:19.670222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43df69-aeb5-4feb-8ec7-31cb6ee61926 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.670604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43df69-aeb5-4feb-8ec7-31cb6ee61926 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.670953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43df69-aeb5-4feb-8ec7-31cb6ee61926 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.672613 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 237/472] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:19.676059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43df69-aeb5-4feb-8ec7-31cb6ee61926 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:19.703073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:19.730265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03afb4c-0283-4aff-8845-b282892be4d9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:19.771617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:19.776751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf8020-3a16-4733-a21f-b07f76c9d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:19.777706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8020-3a16-4733-a21f-b07f76c9d70a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.778178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8020-3a16-4733-a21f-b07f76c9d70a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.778700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf8020-3a16-4733-a21f-b07f76c9d70a None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.779650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8020-3a16-4733-a21f-b07f76c9d70a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:19.780140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8020-3a16-4733-a21f-b07f76c9d70a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:19.783191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf8020-3a16-4733-a21f-b07f76c9d70a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:19.799570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 236/473] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:19.801088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797756-b0ee-4aaa-af2e-b087c40b7290 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.801653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797756-b0ee-4aaa-af2e-b087c40b7290 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.802223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797756-b0ee-4aaa-af2e-b087c40b7290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.808492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43df69-aeb5-4feb-8ec7-31cb6ee61926 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:19.823891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a9797756-b0ee-4aaa-af2e-b087c40b7290 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:19.825428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a9797756-b0ee-4aaa-af2e-b087c40b7290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:19.850028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:19.850746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:19.851147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:19.851975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:19.852637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:19.853354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:19.855229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:19.869802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 238/474] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:19.870755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:19.910058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 237/475] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:19.911736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9797756-b0ee-4aaa-af2e-b087c40b7290 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:20.007945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:20.018455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70566-67aa-4d6d-ae12-ad07d793e53f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:20.045047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9797756-b0ee-4aaa-af2e-b087c40b7290 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:20.085765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693e11a-cc5e-46bb-aa68-b3471fb0821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:20.087209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e11a-cc5e-46bb-aa68-b3471fb0821b None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:20.088378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e11a-cc5e-46bb-aa68-b3471fb0821b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:20.089140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693e11a-cc5e-46bb-aa68-b3471fb0821b None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:20.089991 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693e11a-cc5e-46bb-aa68-b3471fb0821b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:20.091640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693e11a-cc5e-46bb-aa68-b3471fb0821b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:20.098225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466791c3-b134-47a7-8d9b-432edfa48cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:20.098842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466791c3-b134-47a7-8d9b-432edfa48cb0 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:20.099151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466791c3-b134-47a7-8d9b-432edfa48cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:20.099425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466791c3-b134-47a7-8d9b-432edfa48cb0 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:20.100081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466791c3-b134-47a7-8d9b-432edfa48cb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:20.101526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466791c3-b134-47a7-8d9b-432edfa48cb0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:20.128527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 238/476] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:05:19 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:20.130022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:20.154681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 239/477] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:05:19 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:20.210894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693e11a-cc5e-46bb-aa68-b3471fb0821b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:20.336655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693e11a-cc5e-46bb-aa68-b3471fb0821b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:20.381347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:20.391326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:20.391954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:20.392242 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:20.392527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:20.393228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:20.394641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:20.404450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.sql.core [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 19:05:20.404450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 19:05:20.404450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [parameters: {'id': 'cc36d894e9a54ae6979131642667b040', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 19:05:20.404450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81367) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application result.read() Sep 16 19:05:20.422325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return ref.to_dict() Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:05:20.423307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application yield resource Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise self.value Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application session.commit() Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 19:05:20.424494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.session.flush() Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application compat.raise_( Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 19:05:20.425341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:05:20.426175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application result.read() Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:05:20.426984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [parameters: {'id': 'cc36d894e9a54ae6979131642667b040', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:20.429712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 19:05:20.432744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:20.437527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 239/478] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 19:05:20 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:20.443785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466791c3-b134-47a7-8d9b-432edfa48cb0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:20.564244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466791c3-b134-47a7-8d9b-432edfa48cb0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:20.601205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026f07-67e6-4077-b858-29f4585931d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:20.602100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026f07-67e6-4077-b858-29f4585931d3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:20.602382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026f07-67e6-4077-b858-29f4585931d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:20.602721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026f07-67e6-4077-b858-29f4585931d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:20.613506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e026f07-67e6-4077-b858-29f4585931d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-9e026f07-67e6-4077-b858-29f4585931d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:20.619433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:20.620334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:20.621119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 240/479] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:05:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:20.627099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:20.736524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff5799-08cf-4e51-b088-f7d403186b06 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:20.773862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd001d-2e23-4f20-b0b1-5b1456bc647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:20.774477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd001d-2e23-4f20-b0b1-5b1456bc647d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:20.774760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd001d-2e23-4f20-b0b1-5b1456bc647d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:20.775116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd001d-2e23-4f20-b0b1-5b1456bc647d None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:20.775878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd001d-2e23-4f20-b0b1-5b1456bc647d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:20.776191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd001d-2e23-4f20-b0b1-5b1456bc647d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:20.777625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd001d-2e23-4f20-b0b1-5b1456bc647d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:20.786316 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 240/480] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:21.943764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d023e0-9709-4c57-8921-36df52d448d8 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:21.944321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d023e0-9709-4c57-8921-36df52d448d8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:21.944321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d023e0-9709-4c57-8921-36df52d448d8 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:21.946063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 241/481] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:21.952026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe634c-5766-4584-960d-e03d1fb82daf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:21.952531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe634c-5766-4584-960d-e03d1fb82daf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:21.952645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe634c-5766-4584-960d-e03d1fb82daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:21.978705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-05fe634c-5766-4584-960d-e03d1fb82daf None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:21.979958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-05fe634c-5766-4584-960d-e03d1fb82daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:22.043182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:22.074163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 241/482] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:22.082142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc710f-3e3f-4a6b-94aa-b6105a5874c1 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:22.082675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc710f-3e3f-4a6b-94aa-b6105a5874c1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:22.083210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc710f-3e3f-4a6b-94aa-b6105a5874c1 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:22.084725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 242/483] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:22.096202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b65b-643d-4b86-a063-bf44cb3da1a9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:22.096488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b65b-643d-4b86-a063-bf44cb3da1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:22.096767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6b65b-643d-4b86-a063-bf44cb3da1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:22.120087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f6b6b65b-643d-4b86-a063-bf44cb3da1a9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:22.121278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f6b6b65b-643d-4b86-a063-bf44cb3da1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:22.209583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 242/484] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:22.341790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc710f-3e3f-4a6b-94aa-b6105a5874c1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:22.424622 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:22.495734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc710f-3e3f-4a6b-94aa-b6105a5874c1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:22.543679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148f0b-9fd3-4cf5-8cdc-df36f244b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:22.544684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148f0b-9fd3-4cf5-8cdc-df36f244b998 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:22.545174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148f0b-9fd3-4cf5-8cdc-df36f244b998 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:22.545711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148f0b-9fd3-4cf5-8cdc-df36f244b998 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:22.558139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82148f0b-9fd3-4cf5-8cdc-df36f244b998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-82148f0b-9fd3-4cf5-8cdc-df36f244b998 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:22.563379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:22.564256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:22.565028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:22.567544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 243/485] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:22.573795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6b65b-643d-4b86-a063-bf44cb3da1a9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:22.582567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148f0b-9fd3-4cf5-8cdc-df36f244b998 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:22.721738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148f0b-9fd3-4cf5-8cdc-df36f244b998 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:22.752843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6b65b-643d-4b86-a063-bf44cb3da1a9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:22.759919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:22.769323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:22.791512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:22.792127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:22.792411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:22.792680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:22.793344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:22.793649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:22.795289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:22.809585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 243/486] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:22.810952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c2051-91d2-4edf-a3bf-6e5f46418395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:22.811617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c2051-91d2-4edf-a3bf-6e5f46418395 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:22.811896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c2051-91d2-4edf-a3bf-6e5f46418395 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:22.812167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c2051-91d2-4edf-a3bf-6e5f46418395 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:22.815805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:22.835927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c2051-91d2-4edf-a3bf-6e5f46418395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-a72c2051-91d2-4edf-a3bf-6e5f46418395 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:22.841663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:22.842551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:22.843383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:22.847632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 244/487] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:22.849299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c2051-91d2-4edf-a3bf-6e5f46418395 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:22.958017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee85b2-8f6c-44ca-9189-0f178ea6ac2c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:22.974904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c2051-91d2-4edf-a3bf-6e5f46418395 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.003422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d572c6-158d-4024-a4b6-6dea184cecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.004459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d572c6-158d-4024-a4b6-6dea184cecfe None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.004951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d572c6-158d-4024-a4b6-6dea184cecfe None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.005424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d572c6-158d-4024-a4b6-6dea184cecfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.012204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa0366-a99b-4874-a869-31e2ae845bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.012818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa0366-a99b-4874-a869-31e2ae845bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.013098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa0366-a99b-4874-a869-31e2ae845bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.013373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa0366-a99b-4874-a869-31e2ae845bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.014039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa0366-a99b-4874-a869-31e2ae845bd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:23.014342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa0366-a99b-4874-a869-31e2ae845bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.015771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa0366-a99b-4874-a869-31e2ae845bd9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.020488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d572c6-158d-4024-a4b6-6dea184cecfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.022258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d572c6-158d-4024-a4b6-6dea184cecfe None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.028791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 245/488] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:23.030105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaca1a-a3ba-4d37-8a96-23f9af8d984a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.030394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaca1a-a3ba-4d37-8a96-23f9af8d984a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.030675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaca1a-a3ba-4d37-8a96-23f9af8d984a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.036398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 246/489] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:23.036398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaca1a-a3ba-4d37-8a96-23f9af8d984a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-33d572c6-158d-4024-a4b6-6dea184cecfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:23.042866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:23.043943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:23.044957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:23.044957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:23.044957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:23.046461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 244/490] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:23.047842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f160f5-619e-43a8-b766-7f2aeb617cac None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.048239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f160f5-619e-43a8-b766-7f2aeb617cac None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.048692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f160f5-619e-43a8-b766-7f2aeb617cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.068949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-02f160f5-619e-43a8-b766-7f2aeb617cac None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:23.070289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-02f160f5-619e-43a8-b766-7f2aeb617cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:23.092057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:23.101234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:23.160570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 245/491] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:23.160570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f160f5-619e-43a8-b766-7f2aeb617cac None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:23.179497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaca1a-a3ba-4d37-8a96-23f9af8d984a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.237946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.244273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.244273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.244273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.267779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.269185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:23.298323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:23.299280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:23.300107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:23.300107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:23.300107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:23.300107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 247/492] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:23.313312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:23.363269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f160f5-619e-43a8-b766-7f2aeb617cac None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.401878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.402501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.402784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.403095 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.403749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:23.404053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.405433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.418196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 246/493] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:23.423495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:23.455912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:23.493498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:23.508215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590dfd5-30a7-4540-b590-6dc35176c621 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.542848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2c404-a07a-4c5b-afb8-17c9a0d1bad2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.544745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f1c5f-f671-4b46-aa5b-9f4c7aa3289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.545356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1c5f-f671-4b46-aa5b-9f4c7aa3289c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.545633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1c5f-f671-4b46-aa5b-9f4c7aa3289c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.545903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f1c5f-f671-4b46-aa5b-9f4c7aa3289c None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.546539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1c5f-f671-4b46-aa5b-9f4c7aa3289c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:23.546840 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1c5f-f671-4b46-aa5b-9f4c7aa3289c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.548330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f1c5f-f671-4b46-aa5b-9f4c7aa3289c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.561655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 248/494] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:23.562707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e5945-17e0-4f1a-a0f3-d1248be8e3c1 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.563046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e5945-17e0-4f1a-a0f3-d1248be8e3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.563324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e5945-17e0-4f1a-a0f3-d1248be8e3c1 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.564680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 249/495] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:23.565207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e5945-17e0-4f1a-a0f3-d1248be8e3c1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:23.586753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.587427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.587755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.587981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.595746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.597064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:23.610848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:23.611804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:23.612679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 247/496] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:23.613234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:23.682323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e5945-17e0-4f1a-a0f3-d1248be8e3c1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.710983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:23.721853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9c6e3-3cbe-4d71-8c1d-dc8399909595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.722491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9c6e3-3cbe-4d71-8c1d-dc8399909595 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.722774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9c6e3-3cbe-4d71-8c1d-dc8399909595 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.723075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9c6e3-3cbe-4d71-8c1d-dc8399909595 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.734359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9c6e3-3cbe-4d71-8c1d-dc8399909595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:23.736910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c22189-c487-46c2-815c-795b0c12ef22 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4fa9c6e3-3cbe-4d71-8c1d-dc8399909595 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:23.739216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:23.740084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:23.740857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 250/497] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:23.741488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141015-8c7a-47a2-bce8-a510daddc3e2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.741877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141015-8c7a-47a2-bce8-a510daddc3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.741962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141015-8c7a-47a2-bce8-a510daddc3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.761225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-17141015-8c7a-47a2-bce8-a510daddc3e2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:23.762428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-17141015-8c7a-47a2-bce8-a510daddc3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:23.764608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:23.777773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.778858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.779166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.779719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.787551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.789364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:23.802303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:23.803412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:23.804631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 248/498] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:23.807863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:23.833088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 251/499] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:23.833922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141015-8c7a-47a2-bce8-a510daddc3e2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:23.919136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218ede8-80f9-48c4-9b8b-9c94d52a2106 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.938788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141015-8c7a-47a2-bce8-a510daddc3e2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:23.956728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.957515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.957957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.958501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.959936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:23.960247 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.961783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.972268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49a769-5da4-43ca-b763-08566c06f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:23.972881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a769-5da4-43ca-b763-08566c06f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.973163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a769-5da4-43ca-b763-08566c06f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.973441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49a769-5da4-43ca-b763-08566c06f6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.974110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49a769-5da4-43ca-b763-08566c06f6f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:23.974416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49a769-5da4-43ca-b763-08566c06f6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:23.975828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49a769-5da4-43ca-b763-08566c06f6f3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:23.981696 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:23.983867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:23.990037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 252/500] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:23.990037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c8285-bd7e-443d-a079-0ed61c914c53 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:23.990037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c8285-bd7e-443d-a079-0ed61c914c53 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:23.990037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c8285-bd7e-443d-a079-0ed61c914c53 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:23.993275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 253/501] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:23.994585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c8285-bd7e-443d-a079-0ed61c914c53 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.011875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 249/502] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:24.011875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.098526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c8285-bd7e-443d-a079-0ed61c914c53 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.127148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b184-3672-4493-b43a-c3438c14f677 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.132844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cafe5-3fbd-42f5-9314-678813a31ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.133440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cafe5-3fbd-42f5-9314-678813a31ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.133717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cafe5-3fbd-42f5-9314-678813a31ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.134017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cafe5-3fbd-42f5-9314-678813a31ba7 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.134761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cafe5-3fbd-42f5-9314-678813a31ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:24.135093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cafe5-3fbd-42f5-9314-678813a31ba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:24.136540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cafe5-3fbd-42f5-9314-678813a31ba7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:24.160644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.161271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.161548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.161822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.172151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:24.172997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 254/503] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 19:05:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:24.173595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:24.174012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef115-f2a0-41dd-bf70-5831002a7fe5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.174300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef115-f2a0-41dd-bf70-5831002a7fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.174575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef115-f2a0-41dd-bf70-5831002a7fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:24.190169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:24.191168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:24.192031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:24.192031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:24.192031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:24.192031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 250/504] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:24.192031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.193531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5efef115-f2a0-41dd-bf70-5831002a7fe5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:24.194721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5efef115-f2a0-41dd-bf70-5831002a7fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:24.243142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:24.249790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:24.263959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 255/505] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:24.264751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efef115-f2a0-41dd-bf70-5831002a7fe5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.297020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84b7e2-8a20-4e48-ad25-829a9efe131e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.334195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153e740-140a-47db-952e-78df4284f24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.334916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153e740-140a-47db-952e-78df4284f24f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.335225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153e740-140a-47db-952e-78df4284f24f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.335502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153e740-140a-47db-952e-78df4284f24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.375471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efef115-f2a0-41dd-bf70-5831002a7fe5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.406463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153e740-140a-47db-952e-78df4284f24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:24.407962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153e740-140a-47db-952e-78df4284f24f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:24.409660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4db439-2524-4673-b554-c29a40015a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.410283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4db439-2524-4673-b554-c29a40015a8b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.410560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4db439-2524-4673-b554-c29a40015a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.410840 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4db439-2524-4673-b554-c29a40015a8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.421677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4db439-2524-4673-b554-c29a40015a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-af4db439-2524-4673-b554-c29a40015a8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:24.426449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:24.427367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:24.428587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 256/506] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:24.429263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4db439-2524-4673-b554-c29a40015a8b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.473215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:24.487645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:24.536060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 251/507] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:24.537244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153e740-140a-47db-952e-78df4284f24f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.550249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4db439-2524-4673-b554-c29a40015a8b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.584142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a75afb-d039-4604-97dd-c7eb086fffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.584753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75afb-d039-4604-97dd-c7eb086fffaa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.585034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75afb-d039-4604-97dd-c7eb086fffaa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.585309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75afb-d039-4604-97dd-c7eb086fffaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.638183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153e740-140a-47db-952e-78df4284f24f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.652793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a75afb-d039-4604-97dd-c7eb086fffaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:24.654625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a75afb-d039-4604-97dd-c7eb086fffaa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:24.671806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.672411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.672694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.672977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.673619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:24.673930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:24.675319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:24.687345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 252/508] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:24.688132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.700101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:24.704346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:24.756054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 257/509] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:24.756957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a75afb-d039-4604-97dd-c7eb086fffaa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.790185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d411e-b50f-40eb-8ca3-fc9895f58a7b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.824540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.825148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.825436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.825708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.826372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:24.826676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:24.828080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:24.835911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 253/510] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:24.836867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.856975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a75afb-d039-4604-97dd-c7eb086fffaa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.890541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.891123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.891402 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.891674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.901452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:24.902891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:24.906163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:24.911199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:24.919170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:24.920080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:24.920914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:24.920914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:24.920914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:24.920914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 258/511] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:24.921120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:24.940750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54a57-971b-4247-b194-5274d84c25ec None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:24.974585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:24.975244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:24.975593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:24.975870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:24.987320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:24.988779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:25.003221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:25.004146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:25.004982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:25.004982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:25.004982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:25.004982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 254/512] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:25.005200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.026086 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a403c-95b5-43a6-99f4-4fc740b08675 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.059923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.060544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.060822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.061102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.068404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.069851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:25.082368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:25.083404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:25.084279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 259/513] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:25.085090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.106610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5ea79-355b-4cee-bd60-34879b638388 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.129114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:25.142212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.142770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.143083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.143368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.144539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:25.154537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.156005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:25.170865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:25.171770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:25.172611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:25.172611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:25.172611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:25.172611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 255/514] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:25.173093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.188668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d30c1-1dbc-436f-9836-54139954aefa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.222536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.223209 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.223490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.223761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.234529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.236007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:25.251757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:25.252657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:25.253597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:25.253597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:25.253597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:25.253783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 260/515] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:25.254420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.274119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aed634-de00-4234-87a6-5fa6f7e75176 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.308569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.309176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.309460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.309738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.310383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:25.310688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.312098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.324058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 256/516] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:25.324843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.357854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a4a05-9f46-41ea-bf01-4ef95a7c40ee None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.358704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:25.371578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:25.394318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.394851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.395166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.395437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.396071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:25.396372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.397738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.409524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 261/517] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:25.410367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.431092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552283a-18a3-46a5-8bb5-42404eeafc62 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.465776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.466380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.466654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.466933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.467754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:25.468055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.469473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.486892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 257/518] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:25.487998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.511530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d3cd9-c031-4eb9-854a-1c2765061e83 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.546574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.547204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.547485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.547759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.548395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:25.548697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.550091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.561726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 262/519] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:25.562585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.581047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:25.590365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6643b2-893a-48ee-84c1-092c66b20bc5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.595041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:25.624834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.625443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.625728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.626005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.626644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:25.626951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.628403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.639664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 258/520] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:25.640452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.668647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa8c39-8881-48d3-91cf-53b2c45dae4e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.702510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.703160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.703442 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.703715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.710492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.711970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:25.724851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:25.725717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:25.726806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 263/521] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:25.727323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.743308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdfc15-8ab7-4a73-9a32-e22c8d80a577 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.777817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49bb3-a4c1-476e-8ff8-22dbdcb74f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.778424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49bb3-a4c1-476e-8ff8-22dbdcb74f80 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.778731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49bb3-a4c1-476e-8ff8-22dbdcb74f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.779008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d49bb3-a4c1-476e-8ff8-22dbdcb74f80 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.779676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d49bb3-a4c1-476e-8ff8-22dbdcb74f80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.781103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d49bb3-a4c1-476e-8ff8-22dbdcb74f80 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.801795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 259/522] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:05:25 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:25.802598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49bb3-a4c1-476e-8ff8-22dbdcb74f80 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:25.816058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:25.820948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:25.834131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18001781-8fe9-42d4-a03e-f19c506452e0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.873298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe17f0-e01f-49f7-b1c2-a8be5bd6e86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.874096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe17f0-e01f-49f7-b1c2-a8be5bd6e86f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.874456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe17f0-e01f-49f7-b1c2-a8be5bd6e86f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.874825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe17f0-e01f-49f7-b1c2-a8be5bd6e86f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.926571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d49bb3-a4c1-476e-8ff8-22dbdcb74f80 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:25.952230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe17f0-e01f-49f7-b1c2-a8be5bd6e86f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.953838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe17f0-e01f-49f7-b1c2-a8be5bd6e86f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.964555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:25.965302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:25.965665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:25.966018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:25.973289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:25.975023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:25.987460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:25.988331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:25.989163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 260/523] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:25.990112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.064560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:26.066700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:26.075914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 264/524] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:26.080418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe17f0-e01f-49f7-b1c2-a8be5bd6e86f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.109471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf986fe-3a58-43f3-a5f7-cd7b9fd008b3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.148437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:26.149443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:26.151109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:26.151427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:26.160869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:26.162610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:26.174928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:26.176035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:26.176972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 261/525] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:26.177541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.187017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe17f0-e01f-49f7-b1c2-a8be5bd6e86f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.224590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:26.225511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:26.225799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:26.226075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:26.227043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:26.227356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:26.229501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:26.248074 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 265/526] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:26.248887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.293312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f712f-ff37-42bc-a886-7a4da0188321 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.307872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:26.322977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:26.332518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:26.333132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:26.333408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:26.333679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:26.334377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:26.334677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:26.336138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:26.355886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 262/527] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:26.356719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.366208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34e5b-893d-40fd-a355-77904d56fc0c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.402343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:26.403162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:26.403638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:26.403917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:26.414964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:26.417712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:26.433050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:26.434166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:26.435232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:26.435232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:26.435232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:26.438627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 266/528] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:26.439482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.473161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6ea1d-f944-4b5c-8903-65c8e4e22e7d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.511094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:26.511706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:26.511990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:26.512262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:26.512988 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:26.513291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:26.514726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:26.535040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 263/529] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:26.535040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.551339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9510a-a596-437c-b6e2-bcc56aa899a5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.553747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:26.585221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:26.588758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:26.589365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:26.589649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:26.589925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:26.590644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=c915a2b20a2c48a682ef08528e482b96) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:26.590961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:26.592417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:26.598262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 267/530] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/role_assignments?user.id=c915a2b20a2c48a682ef08528e482b96&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:26.598849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.671800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030f8cc-fda3-47cd-85f0-22cf730de35a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.715138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:26.715764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:26.716045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:26.716320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:26.717061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=a909fc6177e94d2fa6d38dad285e616a) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:26.717432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:26.719501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:26.721753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72e1ca-68f0-45f0-9a07-0b199ec9d525 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.726412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 264/531] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/role_assignments?user.id=a909fc6177e94d2fa6d38dad285e616a&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:26.736218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.787986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:26.789558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:26.790110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:26.791111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:26.792160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:26.792632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:26.794920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:26.816002 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 268/532] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:26.826119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:26.864362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:26.937951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e5a6d-5d94-42fd-af5b-8fb6c23acf0b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:26.950436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:26.989024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc5540-b6f1-4dcf-8688-cac9dc2243a0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:27.000804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cb88-3daf-42f9-9aa8-fe8772795c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:27.001423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cb88-3daf-42f9-9aa8-fe8772795c6e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:27.001701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cb88-3daf-42f9-9aa8-fe8772795c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:27.001976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833cb88-3daf-42f9-9aa8-fe8772795c6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:27.061482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:27.062126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:27.062405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:27.062677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:27.080304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:27.082432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:27.095080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:27.096116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:27.097071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:27.097071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:27.097071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:27.097071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:27.097071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:27.097071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:27.097071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:27.097071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:27.098916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 269/533] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:27.109923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:27.110089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cb88-3daf-42f9-9aa8-fe8772795c6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:27.111470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833cb88-3daf-42f9-9aa8-fe8772795c6e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:27.218368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 265/534] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:27.223738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cb88-3daf-42f9-9aa8-fe8772795c6e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:27.240201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:27.276015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:27.292624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b85c08-7c9c-42f2-91a7-7c1f2c4e9e30 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:27.330693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:27.331505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:27.331926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:27.332684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:27.333753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:27.334158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:27.335727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:27.349097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 270/535] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:27.355285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:27.466946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833cb88-3daf-42f9-9aa8-fe8772795c6e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:27.487502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4ad1c-9824-4af1-84d1-3d5e172ea354 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:27.503634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:27.504223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:27.504484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:27.504761 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:27.516030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:27.517480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:27.533720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:27.534610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:27.535491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:27.535491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:27.535491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:27.535491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 266/536] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:27.542089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:27.564206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:27.564818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:27.565104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:27.565380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:27.566112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=1c0ab0eca7de4bed89b5f292a52f8c0a) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:27.566423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:27.567891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:27.581187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 271/537] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:27 2022] GET /identity/v3/role_assignments?user.id=1c0ab0eca7de4bed89b5f292a52f8c0a&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:27.636572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:27.675718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3e8ba-e722-40d6-af7b-800df202213e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:27.715771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:27.716413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:27.716694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:27.716976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:27.717645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:27.717958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:27.719422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:27.734279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 267/538] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:27.739694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:27.764135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:27.882105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539bd6d-68b7-4fcd-bbb8-35d94d91b516 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:27.934593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:27.935244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:27.935595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:27.935923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:27.946848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:27.948300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:27.959947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:27.960807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:27.961631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 272/539] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:27.968595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:28.083994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dce0b-31e2-4416-a298-73d8dfa596a8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:28.108260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:28.120591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4088747-4059-4569-b063-6a488a41d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:28.121208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088747-4059-4569-b063-6a488a41d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:28.121491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088747-4059-4569-b063-6a488a41d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:28.121770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4088747-4059-4569-b063-6a488a41d0e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:28.122466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4088747-4059-4569-b063-6a488a41d0e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:28.122777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4088747-4059-4569-b063-6a488a41d0e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:28.124253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4088747-4059-4569-b063-6a488a41d0e1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:28.137556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 268/540] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:28.143366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:28.273531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:28.325789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed31b90-5ee4-47ac-9626-e5bbd49d4a32 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:28.334331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7cbe-5b01-4b65-8be8-d857a37ee118 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:28.334865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7cbe-5b01-4b65-8be8-d857a37ee118 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:28.335391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e7cbe-5b01-4b65-8be8-d857a37ee118 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:28.337258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 269/541] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:28.344551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a876-5973-4430-898a-fd83c8f0d6f3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:28.344837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a876-5973-4430-898a-fd83c8f0d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:28.345151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5a876-5973-4430-898a-fd83c8f0d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:28.378894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-90a5a876-5973-4430-898a-fd83c8f0d6f3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:28.380691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-90a5a876-5973-4430-898a-fd83c8f0d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:28.392608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:28.393243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:28.393529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:28.393803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:28.394535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=1ef7ff56b97e4ca3af05cc407419d906) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:28.394844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:28.396320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:28.407423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 273/542] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:28 2022] GET /identity/v3/role_assignments?user.id=1ef7ff56b97e4ca3af05cc407419d906&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:28.479439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 270/543] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:28.847762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:28.986104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19de37-2dcc-4124-b2df-f04738dd46e7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:29.032278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce863c44-76e8-4ad4-9c81-00d597121567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:29.033350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce863c44-76e8-4ad4-9c81-00d597121567 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.033845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce863c44-76e8-4ad4-9c81-00d597121567 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.034310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce863c44-76e8-4ad4-9c81-00d597121567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.037868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:29.047315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce863c44-76e8-4ad4-9c81-00d597121567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ce863c44-76e8-4ad4-9c81-00d597121567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:29.052765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:29.053688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:29.054490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:29.060266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 274/544] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:29.066277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5a876-5973-4430-898a-fd83c8f0d6f3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:29.220721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5a876-5973-4430-898a-fd83c8f0d6f3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:29.241430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:29.241774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe3796-2d10-4b8b-b4aa-0f6d579d32db None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.242196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe3796-2d10-4b8b-b4aa-0f6d579d32db None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.242291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe3796-2d10-4b8b-b4aa-0f6d579d32db None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.243995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 275/545] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:29.250689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545996-001d-47b1-b254-e45d22476db0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.251257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545996-001d-47b1-b254-e45d22476db0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.251751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545996-001d-47b1-b254-e45d22476db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.278265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-77545996-001d-47b1-b254-e45d22476db0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:29.280167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:29.280782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.281058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.281329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.281994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:29.282295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:29.283667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:29.285295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-77545996-001d-47b1-b254-e45d22476db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:29.301064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 271/546] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:29.308146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:29.370763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 276/547] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:29.446398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c512de-b856-4474-a7b6-f65898a8a4a3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:29.483793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:29.484342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.484615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.484889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.496895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:29.498370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:29.514248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:29.515170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:29.516002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:29.516002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:29.516002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:29.516002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 272/548] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:29.521314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545996-001d-47b1-b254-e45d22476db0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:29.654356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77545996-001d-47b1-b254-e45d22476db0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:29.687662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:29.694094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:29.708120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af6bdd-42ef-4503-a2dd-267d2265b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:29.709363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af6bdd-42ef-4503-a2dd-267d2265b5ea None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.709655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af6bdd-42ef-4503-a2dd-267d2265b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.709936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af6bdd-42ef-4503-a2dd-267d2265b5ea None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.710947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af6bdd-42ef-4503-a2dd-267d2265b5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:29.711292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af6bdd-42ef-4503-a2dd-267d2265b5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:29.713634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af6bdd-42ef-4503-a2dd-267d2265b5ea None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:29.729302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 277/549] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:29.731430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffbe3c-5205-4cf9-ae68-dec1bf8e21e2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.731727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffbe3c-5205-4cf9-ae68-dec1bf8e21e2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.732101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffbe3c-5205-4cf9-ae68-dec1bf8e21e2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.733570 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 278/550] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:29.738213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffbe3c-5205-4cf9-ae68-dec1bf8e21e2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:29.741244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:29.832258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c4a5-b371-4213-84d9-b90f3c13d238 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:29.872809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffbe3c-5205-4cf9-ae68-dec1bf8e21e2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:29.880230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9089f-3f1c-4c7d-9b35-792a85f1fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:29.881578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9089f-3f1c-4c7d-9b35-792a85f1fc24 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.882184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9089f-3f1c-4c7d-9b35-792a85f1fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.882652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9089f-3f1c-4c7d-9b35-792a85f1fc24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.895268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9089f-3f1c-4c7d-9b35-792a85f1fc24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-3ed9089f-3f1c-4c7d-9b35-792a85f1fc24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:29.902214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:29.903538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:29.904353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:29.907806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 273/551] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:29.909594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f100-578b-424a-8212-7a5a6fd70613 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.910149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f100-578b-424a-8212-7a5a6fd70613 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.910697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4f100-578b-424a-8212-7a5a6fd70613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.910941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:29.911593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:29.911868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:29.912199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:29.920994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:29.922436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:29.933509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-16e4f100-578b-424a-8212-7a5a6fd70613 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:29.934848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:29.935834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:29.936825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:29.937935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-16e4f100-578b-424a-8212-7a5a6fd70613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:29.940859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 279/552] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:29.942300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:29.991354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:30.027272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 274/553] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:30.028207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4f100-578b-424a-8212-7a5a6fd70613 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:30.059250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:30.065909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b8659-f04b-410e-9fc9-1bd937653820 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:30.113658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:30.114623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.115132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.115677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.116596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:30.117150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:30.119875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:30.130096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 280/554] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:30.136811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:30.242792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4f100-578b-424a-8212-7a5a6fd70613 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:30.283486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd9ddd-dd6d-4cb5-9c00-a64fc15342aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:30.284701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9ddd-dd6d-4cb5-9c00-a64fc15342aa None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.285663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9ddd-dd6d-4cb5-9c00-a64fc15342aa None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.286168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd9ddd-dd6d-4cb5-9c00-a64fc15342aa None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.287845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd9ddd-dd6d-4cb5-9c00-a64fc15342aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:30.288360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd9ddd-dd6d-4cb5-9c00-a64fc15342aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:30.291181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd9ddd-dd6d-4cb5-9c00-a64fc15342aa None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:30.295879 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8d27d-3559-4540-b835-9ba3e91a372d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:30.307418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:30.322205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 275/555] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 19:05:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:30.322205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478fe8-af35-415f-8f71-a7570505974c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.322205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478fe8-af35-415f-8f71-a7570505974c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.322205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e478fe8-af35-415f-8f71-a7570505974c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.322205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 276/556] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:30.323217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478fe8-af35-415f-8f71-a7570505974c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:30.348393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cf587-4874-4fdd-b80f-9422b5c6b20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:30.349019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf587-4874-4fdd-b80f-9422b5c6b20f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.349298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf587-4874-4fdd-b80f-9422b5c6b20f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.349571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cf587-4874-4fdd-b80f-9422b5c6b20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.361459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cf587-4874-4fdd-b80f-9422b5c6b20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:30.362912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cf587-4874-4fdd-b80f-9422b5c6b20f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-950cf587-4874-4fdd-b80f-9422b5c6b20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:30.377102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:30.378022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:30.378887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:30.378887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:30.378887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:30.378887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 281/557] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:30.379423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdddfa3-0011-4838-86eb-de55ff5a3baa None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.379594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdddfa3-0011-4838-86eb-de55ff5a3baa None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.379865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdddfa3-0011-4838-86eb-de55ff5a3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.397472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ecdddfa3-0011-4838-86eb-de55ff5a3baa None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:30.398657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ecdddfa3-0011-4838-86eb-de55ff5a3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:30.423063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:30.458704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e478fe8-af35-415f-8f71-a7570505974c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:30.490732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 282/558] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:30.491910 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdddfa3-0011-4838-86eb-de55ff5a3baa None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:30.502718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45e5cb-24d4-4723-a031-478fa69fefb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:30.503303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45e5cb-24d4-4723-a031-478fa69fefb9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.503585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45e5cb-24d4-4723-a031-478fa69fefb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.503859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45e5cb-24d4-4723-a031-478fa69fefb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.586421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45e5cb-24d4-4723-a031-478fa69fefb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:30.589430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45e5cb-24d4-4723-a031-478fa69fefb9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:30.605013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:30.617042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdddfa3-0011-4838-86eb-de55ff5a3baa None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:30.654886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441157e-bf02-433e-b1c8-895dbc54166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:30.655553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441157e-bf02-433e-b1c8-895dbc54166d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.656056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441157e-bf02-433e-b1c8-895dbc54166d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.656208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441157e-bf02-433e-b1c8-895dbc54166d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.667831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441157e-bf02-433e-b1c8-895dbc54166d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d441157e-bf02-433e-b1c8-895dbc54166d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:30.673157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:30.674065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:30.674888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 283/559] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:30.676068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441157e-bf02-433e-b1c8-895dbc54166d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:30.687713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:30.718179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 277/560] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 19:05:30.723556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45e5cb-24d4-4723-a031-478fa69fefb9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:30.806535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441157e-bf02-433e-b1c8-895dbc54166d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:30.833611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45e5cb-24d4-4723-a031-478fa69fefb9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:30.843364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:30.843977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.844246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.844515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.845159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:30.845458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:30.846871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:30.859361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 284/561] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:30.860000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:30.872846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:30.875978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:30.877447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:30.877737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:30.878019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:30.878705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:30.879008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:30.880604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:30.890062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 278/562] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:30.890979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:30.934632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:30.972507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52eb77-8fc8-4e72-8906-7255b54103ac None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.006293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820956c3-4722-4ccb-8671-8080ab306c74 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.008121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.008754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.009061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.009337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.019940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.021387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:31.036395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:31.037317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:31.038186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:31.038186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:31.038186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:31.038186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 285/563] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:31.038404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.042216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978bec4-bde0-4acc-aa36-501f003c8dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.042846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bec4-bde0-4acc-aa36-501f003c8dfd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.043153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bec4-bde0-4acc-aa36-501f003c8dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.043428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978bec4-bde0-4acc-aa36-501f003c8dfd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.054298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978bec4-bde0-4acc-aa36-501f003c8dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-8978bec4-bde0-4acc-aa36-501f003c8dfd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:31.059622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:31.060511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:31.061342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 279/564] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:31.062018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978bec4-bde0-4acc-aa36-501f003c8dfd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.102139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:31.141675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6fabb-9e35-4689-8acc-550bf3034f0e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.155473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:31.161501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978bec4-bde0-4acc-aa36-501f003c8dfd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.176396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d59ca-1c84-4ff1-ae46-a9e32b15ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.177037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d59ca-1c84-4ff1-ae46-a9e32b15ce82 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.177317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d59ca-1c84-4ff1-ae46-a9e32b15ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.177589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d59ca-1c84-4ff1-ae46-a9e32b15ce82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.185838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d59ca-1c84-4ff1-ae46-a9e32b15ce82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.187322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d59ca-1c84-4ff1-ae46-a9e32b15ce82 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.195495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.196118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.196398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.197165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-833d59ca-1c84-4ff1-ae46-a9e32b15ce82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:31.198904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:31.199890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:31.200795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 286/565] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:31.201390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f9058-77ef-4b32-af5b-9f8396d527e3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.201456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f9058-77ef-4b32-af5b-9f8396d527e3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.201727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f9058-77ef-4b32-af5b-9f8396d527e3 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.203266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 287/566] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:31.203973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f9058-77ef-4b32-af5b-9f8396d527e3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.210685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.212732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:31.226950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:31.228443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:31.229649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:31.229649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:31.229649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:31.229649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 280/567] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:31.233306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.305651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f9058-77ef-4b32-af5b-9f8396d527e3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.328190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:31.334631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c3625-1929-4153-ae00-da962e17747f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.341291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.342314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.342598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.342875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.343550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:31.343855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.345227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.357945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 288/568] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:31.358737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.373843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18925c45-f093-4384-86de-fd94ad778c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.374451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925c45-f093-4384-86de-fd94ad778c87 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.374727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925c45-f093-4384-86de-fd94ad778c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.375017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18925c45-f093-4384-86de-fd94ad778c87 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.375767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18925c45-f093-4384-86de-fd94ad778c87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:31.376072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18925c45-f093-4384-86de-fd94ad778c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.377446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18925c45-f093-4384-86de-fd94ad778c87 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.385506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 281/569] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:31.386656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fe62e-fdf4-4669-a7b5-82a73da4e52e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.386940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fe62e-fdf4-4669-a7b5-82a73da4e52e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.387246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fe62e-fdf4-4669-a7b5-82a73da4e52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.404367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d21fe62e-fdf4-4669-a7b5-82a73da4e52e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:31.405563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d21fe62e-fdf4-4669-a7b5-82a73da4e52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:31.408305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:31.466507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4eae6-7dd7-42d5-aab5-3ae3739ca97b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.475858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 282/570] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:31.476952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fe62e-fdf4-4669-a7b5-82a73da4e52e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.502663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.503330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.503609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.503880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.504622 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:31.504911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.506333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.529071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 289/571] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:31.529071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.574932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:31.593756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fe62e-fdf4-4669-a7b5-82a73da4e52e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.631779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.632392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.632766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.632957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.633572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:31.633872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.636311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.641598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01ffdd-8198-4ed5-8cfc-4184537e67ae None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.645631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:31.649275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 283/572] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:31.655153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.679711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.680369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.680648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.680955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.688020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.689445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:31.700811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:31.701744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 290/573] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:31.703394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.771977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df78947-8cbb-4a76-864b-77ec7a15c583 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.807327 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.807964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.808243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.808519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.810156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:31.817059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8438a63-27f3-48c3-9a82-399764c62341 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.819659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.821100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:31.836081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:31.837677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:31.839364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:31.839364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:31.839364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:31.839364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 284/574] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:31.839364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.865231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:31.865951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:31.866330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:31.866706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:31.877781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:31.879458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:31.893922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:31.895096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:31.896131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:31.896131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:31.896131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:31.901551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 291/575] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:31.901551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:31.908342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:31.964512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57398e7f-fb69-4a0a-b977-2d5f42badd09 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:31.999579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.000216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.000502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.000778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.004140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753591fc-220f-4dcd-ac74-e03205a29be1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.008518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.010299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:32.021734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:32.022709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 285/576] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:32.023703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.044692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.045299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.045586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.045861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.047099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:32.047412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.049153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.063309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 292/577] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:32.064258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.083580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:32.132344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7a5ed-c4ef-4c1e-8083-f22faaf52a8b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.145608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:32.168330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50a3ad-cf25-40d1-b724-2b94e1fd90a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.168970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50a3ad-cf25-40d1-b724-2b94e1fd90a3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.169287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50a3ad-cf25-40d1-b724-2b94e1fd90a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.169591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50a3ad-cf25-40d1-b724-2b94e1fd90a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.172635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3d29d-2793-4b1e-ae16-4e7777163f7c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.179520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50a3ad-cf25-40d1-b724-2b94e1fd90a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2a50a3ad-cf25-40d1-b724-2b94e1fd90a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:32.185334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:32.186230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:32.187070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 286/578] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:32.187745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50a3ad-cf25-40d1-b724-2b94e1fd90a3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.208750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.209357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.209640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.209913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.210554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:32.210857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.212260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.223456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 293/579] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:32.224403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.295231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50a3ad-cf25-40d1-b724-2b94e1fd90a3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.296567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:32.326558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe8316-d45e-4b8f-aaaa-1d202c464c6b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.330122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.330745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.331087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.331405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.332076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:32.332415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.333811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.346181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 287/580] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:32.347099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.368138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.368823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.369187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.369470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.370206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:32.370515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.371994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.377514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:32.394243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 294/581] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:32.394243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.452330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e99bb-647c-4a09-94e2-b2280303c830 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.487540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.488157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.488472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.488779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.489534 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=778fb2fe04a242a0a7e4b5b062fc0775) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:32.489856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.491328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.491925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705dd3f4-f0ac-422e-b1f5-3a4f921309ca None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.496865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 288/582] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/role_assignments?user.id=778fb2fe04a242a0a7e4b5b062fc0775&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:32.497649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.543738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:32.552984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.553779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.554055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.554324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.555404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:32.555709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.557539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.574665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 295/583] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:32.574665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.610492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:32.621214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816e065-5d01-470b-bfc8-136736e04254 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.666901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.667807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.668086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.668507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.677398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.678845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:32.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:32.691625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 289/584] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:32.692591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.699652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77d4a-a06e-4fb4-b8e8-7c897f029aa6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.734936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.735979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.736270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.736543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.743909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.745356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:32.756715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:32.757623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:32.758497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:32.758497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:32.758497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:32.758497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:32.758497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:32.758497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:32.758497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:32.758497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:32.762801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 296/585] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:32.763889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.809287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c659e4-999e-4bec-997c-6d4b3844951e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.820292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:32.845122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.845762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.846046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.846326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.859632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.861225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:32.876231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:32.877196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:32.878105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:32.878105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:32.878105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:32.878950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca351a7d-db4f-46f6-b56e-23de715d8aac None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:32.881873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 290/586] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:32.882700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.895603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:32.914955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:32.916159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:32.916453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:32.916805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:32.927958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:32.929340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:32.944343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:32.945326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:32.946202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:32.946202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:32.946202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:32.950784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 297/587] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:32.951656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:32.996748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf7d4a-cf0e-4ca7-90ad-69d0118673d4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.036040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.036819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.037109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.037385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.038509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:33.038869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.040393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.057317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21bb24-4e7e-413d-8964-c3a72d8d8e39 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.059639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 291/588] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:33.060468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.065624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:33.100254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.101173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.101902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.102377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.103888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:33.104403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.107092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.123480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 298/589] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:33.124573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.134126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:33.172521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da7fb3-c8ad-4ece-ab71-4ac57f5a6365 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.211476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.212910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.213204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.213479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.214128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:33.214436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.216305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.227600 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbead33-1653-4e17-b50b-2a5b35ad967c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.232099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 292/590] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:33.233194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.264130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.264742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.265199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.265377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.266022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:33.266370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.267771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.285133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 299/591] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:33.285133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.313453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:33.350341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac647fa-7b9d-4fe0-8815-f1f9c48f5286 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.380169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:33.390773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.391545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.391827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.392104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.397565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd4c73-df97-4a34-8818-12487f115091 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.405839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.407571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:33.423508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:33.424675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:33.425562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:33.425562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:33.425562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:33.425562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 293/592] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:33.427136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.445909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec0c2b-edbb-4700-a6b5-2af9cb876cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.447158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec0c2b-edbb-4700-a6b5-2af9cb876cdb None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.447404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec0c2b-edbb-4700-a6b5-2af9cb876cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.447692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec0c2b-edbb-4700-a6b5-2af9cb876cdb None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/c915a2b20a2c48a682ef08528e482b96/roles/6caaeeebf7094f598c0e46561cb52144` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.463094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec0c2b-edbb-4700-a6b5-2af9cb876cdb None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=c915a2b20a2c48a682ef08528e482b96, role_id=6caaeeebf7094f598c0e46561cb52144)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.464751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec0c2b-edbb-4700-a6b5-2af9cb876cdb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.477856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 300/593] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:05:33 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/c915a2b20a2c48a682ef08528e482b96/roles/6caaeeebf7094f598c0e46561cb52144 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:33.484347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec0c2b-edbb-4700-a6b5-2af9cb876cdb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.547836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9defee6-49a7-4592-8a18-dd1098d736bd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.589115 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.589804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.590088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.590368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.598912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.600481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.610079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:33.615562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:33.616679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:33.619308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:33.619308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:33.619308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:33.619308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:33.619308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:33.619308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:33.619308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:33.619308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:33.621859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 294/594] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:33.622838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.655342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec0c2b-edbb-4700-a6b5-2af9cb876cdb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.693665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:33.707807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.708460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.708740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.709068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.719327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.721118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:33.743408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:33.745530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 301/595] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:33.747710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.782105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47835e0-92ad-46d2-924c-c61a92747f23 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.833800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.834743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.834743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.834936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.835610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:33.835919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.838374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.856674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 295/596] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:33.857792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.906909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1258e74-3d67-4d8d-a802-dad713fe2223 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:33.954306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:33.955719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:33.956421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:33.960913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:33.961902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:33.963023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:33.964790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:33.966778 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:33.982248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 302/597] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:33.983598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:33.987450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:33.992728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c0b2-8401-4772-a585-09d7a822cfc9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:34.037403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:34.039212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.039212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.039212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.039433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:34.039733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:34.041787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:34.063809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 296/598] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:34.064663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:34.119859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e42589-f5fe-42f9-9f09-4134d58c995d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:34.158743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:34.160130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.160630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.161125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.169735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:34.171742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:34.184872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:34.186092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:34.186961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:34.186961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:34.186961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:34.186961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:34.186961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:34.186961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:34.186961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:34.186961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:34.189636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 303/599] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:34.190794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:34.195372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989019d-02b8-4872-ae70-a57d5ce5eff6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:34.240050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3631ea-b678-4e26-9531-1e8481b91ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:34.241088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3631ea-b678-4e26-9531-1e8481b91ce3 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.241628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3631ea-b678-4e26-9531-1e8481b91ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.242119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3631ea-b678-4e26-9531-1e8481b91ce3 None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/a909fc6177e94d2fa6d38dad285e616a/roles/6caaeeebf7094f598c0e46561cb52144` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.259647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3631ea-b678-4e26-9531-1e8481b91ce3 None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=a909fc6177e94d2fa6d38dad285e616a, role_id=6caaeeebf7094f598c0e46561cb52144)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:34.261495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3631ea-b678-4e26-9531-1e8481b91ce3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:34.263356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:34.279364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 297/600] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:05:34 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/a909fc6177e94d2fa6d38dad285e616a/roles/6caaeeebf7094f598c0e46561cb52144 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:34.280701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3631ea-b678-4e26-9531-1e8481b91ce3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:34.292343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:34.325130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d071-35ca-4ce0-84cb-1ac050c2d810 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:34.367138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:34.367718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.368004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.368998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.382212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:34.391021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:34.401894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:34.409603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:34.410777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:34.410777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:34.410777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:34.410777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 304/601] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:34.411380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:34.459395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3631ea-b678-4e26-9531-1e8481b91ce3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:34.529839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:34.530769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.531293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.531763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.532524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:34.532839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:34.538280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:34.558169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 298/602] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:34.565482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:34.625546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb510-58a1-4a0a-a2a0-64adb628fcdb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:34.636562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:34.658388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:34.676412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:34.677446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.677932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.678453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.679904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:34.680446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:34.682081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:34.697623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 305/603] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:34.707971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:34.720514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc5677-419e-4558-a473-6e77930b791a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:34.761420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624e6cc-d38f-4bc0-a22d-ea94921443a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:34.762119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624e6cc-d38f-4bc0-a22d-ea94921443a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.763327 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624e6cc-d38f-4bc0-a22d-ea94921443a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.763697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624e6cc-d38f-4bc0-a22d-ea94921443a0 None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/1c0ab0eca7de4bed89b5f292a52f8c0a/roles/6caaeeebf7094f598c0e46561cb52144` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.801292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624e6cc-d38f-4bc0-a22d-ea94921443a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=1c0ab0eca7de4bed89b5f292a52f8c0a, role_id=6caaeeebf7094f598c0e46561cb52144)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:34.802710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624e6cc-d38f-4bc0-a22d-ea94921443a0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:34.824599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 299/604] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:05:34 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/1c0ab0eca7de4bed89b5f292a52f8c0a/roles/6caaeeebf7094f598c0e46561cb52144 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:05:34.879026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628f2ac-7547-4b62-8486-7b802ad3d86d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.879315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628f2ac-7547-4b62-8486-7b802ad3d86d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.879594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628f2ac-7547-4b62-8486-7b802ad3d86d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.881199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 300/605] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:05:34.887189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362c6a1-7fd9-4dda-b8ee-3759b9a7dd2a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:34.887475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362c6a1-7fd9-4dda-b8ee-3759b9a7dd2a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:34.887757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362c6a1-7fd9-4dda-b8ee-3759b9a7dd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:34.908704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4362c6a1-7fd9-4dda-b8ee-3759b9a7dd2a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:34.909954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4362c6a1-7fd9-4dda-b8ee-3759b9a7dd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:34.922222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918af36-e883-4585-b83a-9ce89aa3aaf6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:35.000296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:35.000996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:35.001282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:35.001556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:35.017781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:35.018212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:35.037090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:35.038060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:35.039626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 306/606] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:35.041925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 301/607] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:35.048085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:35.084118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:35.161222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c2b56-e7e9-454d-86a5-894f4971f0d4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:35.199530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:35.200135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:35.200411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:35.200683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:35.201459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:35.201762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:35.207250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:35.220852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 307/608] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:35.226313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362c6a1-7fd9-4dda-b8ee-3759b9a7dd2a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:35.306608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:35.379550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362c6a1-7fd9-4dda-b8ee-3759b9a7dd2a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:35.434240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d4522-06c5-4f79-b30d-1178c46fa73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:35.434240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d4522-06c5-4f79-b30d-1178c46fa73a None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:35.434240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d4522-06c5-4f79-b30d-1178c46fa73a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:35.434240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d4522-06c5-4f79-b30d-1178c46fa73a None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/1ef7ff56b97e4ca3af05cc407419d906/roles/6caaeeebf7094f598c0e46561cb52144` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:35.457944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d4522-06c5-4f79-b30d-1178c46fa73a None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=1ef7ff56b97e4ca3af05cc407419d906, role_id=6caaeeebf7094f598c0e46561cb52144)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:35.459443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d4522-06c5-4f79-b30d-1178c46fa73a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:35.474751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:35.488710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 302/609] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:05:35 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/1ef7ff56b97e4ca3af05cc407419d906/roles/6caaeeebf7094f598c0e46561cb52144 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:35.611351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:35.628118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dadb9-323c-4f79-bb27-b1535f4443ad None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:35.676763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08c1d1-ea33-4c49-b44f-b0d4cb8624d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:35.677316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08c1d1-ea33-4c49-b44f-b0d4cb8624d7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:35.677599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08c1d1-ea33-4c49-b44f-b0d4cb8624d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:35.677877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08c1d1-ea33-4c49-b44f-b0d4cb8624d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:35.696962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08c1d1-ea33-4c49-b44f-b0d4cb8624d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2f08c1d1-ea33-4c49-b44f-b0d4cb8624d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:35.701782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:35.702737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:35.703772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 308/610] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:35.709156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d4522-06c5-4f79-b30d-1178c46fa73a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:35.826250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:35.832280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d4522-06c5-4f79-b30d-1178c46fa73a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:35.869699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:35.870315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:35.870598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:35.870876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:35.871577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:35.871882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:35.873246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:35.882122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 303/611] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:35.888341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08c1d1-ea33-4c49-b44f-b0d4cb8624d7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:36.011004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08c1d1-ea33-4c49-b44f-b0d4cb8624d7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:36.059180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee708c-f3b4-40e9-a275-40e632456134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:36.059853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee708c-f3b4-40e9-a275-40e632456134 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:36.060132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee708c-f3b4-40e9-a275-40e632456134 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:36.060409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee708c-f3b4-40e9-a275-40e632456134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:36.074860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee708c-f3b4-40e9-a275-40e632456134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:36.076540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee708c-f3b4-40e9-a275-40e632456134 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:36.091489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-edee708c-f3b4-40e9-a275-40e632456134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:36.100091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:36.101043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:36.102617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:36.102617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:36.102617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:36.102617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 309/612] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:36.107478 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:36.212889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc1f29-ee95-499b-b88c-b5c32b4dbf8d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:36.244796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4ff5-64c2-4451-a906-b7fb06008bfc None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:36.245121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4ff5-64c2-4451-a906-b7fb06008bfc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:36.245348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da4ff5-64c2-4451-a906-b7fb06008bfc None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:36.246757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 310/613] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:05:36.251950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55acadf-835d-4657-adff-6791991c100a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:36.252234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55acadf-835d-4657-adff-6791991c100a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:36.252570 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55acadf-835d-4657-adff-6791991c100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:36.260190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:36.260806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:36.261143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:36.261364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:36.262944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:36.263285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:36.269459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:36.283743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f55acadf-835d-4657-adff-6791991c100a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:36.284951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f55acadf-835d-4657-adff-6791991c100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:36.292298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 304/614] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:36.297757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:36.323353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:36.419610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 311/615] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:36.466712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec422773-ca32-4ea6-9587-da3ac49d3e10 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:36.519519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:36.520079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:36.520362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:36.520774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:36.532713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:36.534163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:36.551162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:36.552149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:36.553682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 305/616] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:36.557955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55acadf-835d-4657-adff-6791991c100a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:36.685160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55acadf-835d-4657-adff-6791991c100a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:36.717840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:36.730400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:36.731030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:36.735343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:36.736154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:36.736310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:36.737367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:36.737817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:36.739413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:36.763902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 312/617] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 19:05:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:36.771326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:36.813439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:36.839932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad6cc2-71d1-4f28-b317-27a474eda302 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:36.877937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279d14f-2b03-4a8d-9f1f-ddaae1bacac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:36.878848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d14f-2b03-4a8d-9f1f-ddaae1bacac2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:36.879304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d14f-2b03-4a8d-9f1f-ddaae1bacac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:36.879750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279d14f-2b03-4a8d-9f1f-ddaae1bacac2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:36.891561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279d14f-2b03-4a8d-9f1f-ddaae1bacac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-3279d14f-2b03-4a8d-9f1f-ddaae1bacac2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:36.897043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:36.898163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:36.899215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:36.901925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 306/618] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:36.907716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279d14f-2b03-4a8d-9f1f-ddaae1bacac2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:36.982724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a309-c50b-4ef5-bb74-553e768d6b7c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.060453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b4b6b-13e5-44c8-8498-3977add3e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.061036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4b6b-13e5-44c8-8498-3977add3e578 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.061321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4b6b-13e5-44c8-8498-3977add3e578 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.061595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b4b6b-13e5-44c8-8498-3977add3e578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.075844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b4b6b-13e5-44c8-8498-3977add3e578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:37.077523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b4b6b-13e5-44c8-8498-3977add3e578 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:37.081412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279d14f-2b03-4a8d-9f1f-ddaae1bacac2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-878b4b6b-13e5-44c8-8498-3977add3e578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:37.096610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:37.097747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:37.098628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:37.098628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:37.098628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:37.098628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 313/619] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:37.104414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add4a26-5ea1-442f-b239-83c13e3babac None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.104414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add4a26-5ea1-442f-b239-83c13e3babac None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.104414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add4a26-5ea1-442f-b239-83c13e3babac None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.106661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 314/620] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:37.107506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add4a26-5ea1-442f-b239-83c13e3babac None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:37.130754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744f6e4-9f84-4858-bbae-36a3c56c4c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.131805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f6e4-9f84-4858-bbae-36a3c56c4c0e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.132464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f6e4-9f84-4858-bbae-36a3c56c4c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.132949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f6e4-9f84-4858-bbae-36a3c56c4c0e None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.133853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f6e4-9f84-4858-bbae-36a3c56c4c0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:37.134531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f6e4-9f84-4858-bbae-36a3c56c4c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:37.136398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f6e4-9f84-4858-bbae-36a3c56c4c0e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:37.142492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:37.148861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 307/621] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:37.155650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8259b4-d3f5-4fbc-8402-1b60befa04db None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.156182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8259b4-d3f5-4fbc-8402-1b60befa04db None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.156701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:37.157882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8259b4-d3f5-4fbc-8402-1b60befa04db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.179283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cc8259b4-d3f5-4fbc-8402-1b60befa04db None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:37.181068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cc8259b4-d3f5-4fbc-8402-1b60befa04db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:37.231728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add4a26-5ea1-442f-b239-83c13e3babac None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.273062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 308/622] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:37.275841 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8259b4-d3f5-4fbc-8402-1b60befa04db None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:37.287338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.290538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.292428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.292976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.293839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:37.294368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:37.297024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:37.325439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 315/623] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:37.331055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:37.475858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8259b4-d3f5-4fbc-8402-1b60befa04db None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.484058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:37.488458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b61df-a7e2-4674-ae13-c788f3542be3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.516769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:37.525385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.526029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.526315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.526426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e713eb-b19a-4ee3-b73d-005763d7d726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.526589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.527435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e713eb-b19a-4ee3-b73d-005763d7d726 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.527814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e713eb-b19a-4ee3-b73d-005763d7d726 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.528194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e713eb-b19a-4ee3-b73d-005763d7d726 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.537989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e713eb-b19a-4ee3-b73d-005763d7d726 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:37.538985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:37.539610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e713eb-b19a-4ee3-b73d-005763d7d726 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:37.540719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f3e713eb-b19a-4ee3-b73d-005763d7d726 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:37.551478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:37.552483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:37.553361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 316/624] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:37.557032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86fd7-83d0-41d5-a434-be3c714d8454 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.557032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86fd7-83d0-41d5-a434-be3c714d8454 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.557032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86fd7-83d0-41d5-a434-be3c714d8454 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.560988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 317/625] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:37.562119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e6dd6-8de8-4a5a-ad1e-5c72cd0843d4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.562400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e6dd6-8de8-4a5a-ad1e-5c72cd0843d4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.562679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e6dd6-8de8-4a5a-ad1e-5c72cd0843d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:37.564073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:37.564985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:37.566697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:37.566697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:37.566697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:37.566697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 309/626] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:37.566697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:37.589898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c21e6dd6-8de8-4a5a-ad1e-5c72cd0843d4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:37.591205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c21e6dd6-8de8-4a5a-ad1e-5c72cd0843d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:37.675018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 318/627] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:37.675018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e6dd6-8de8-4a5a-ad1e-5c72cd0843d4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:37.689805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904ecea-5223-4c71-acdb-f7774b7698b7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.729762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.730378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.730836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.731149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.732324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:37.732784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:37.734215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:37.750927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 310/628] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:37.751897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:37.767938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:37.782196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e6dd6-8de8-4a5a-ad1e-5c72cd0843d4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.808333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:37.820152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.820772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.821110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.821418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.822177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:37.822489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:37.823958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:37.837656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 319/629] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:37.838455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:37.883183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df86b3-7c97-4be7-b52c-2e19cc5f3776 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.928207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f06ab-3082-440f-9bd6-af27a6ba1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.929235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f06ab-3082-440f-9bd6-af27a6ba1f0e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.929639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f06ab-3082-440f-9bd6-af27a6ba1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.930023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f06ab-3082-440f-9bd6-af27a6ba1f0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:37.943190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f06ab-3082-440f-9bd6-af27a6ba1f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-327f06ab-3082-440f-9bd6-af27a6ba1f0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:37.949755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:37.950763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:37.951631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:37.952843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82037ad-09df-4231-b0e6-4a1f03697738 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:37.953004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 311/630] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:37.953004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f06ab-3082-440f-9bd6-af27a6ba1f0e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:37.995508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08cc5-64cc-49c4-b471-6bbdaa82fead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:37.996285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08cc5-64cc-49c4-b471-6bbdaa82fead None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:37.996566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08cc5-64cc-49c4-b471-6bbdaa82fead None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:37.996842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08cc5-64cc-49c4-b471-6bbdaa82fead None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/778fb2fe04a242a0a7e4b5b062fc0775/roles/6caaeeebf7094f598c0e46561cb52144` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.012500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee08cc5-64cc-49c4-b471-6bbdaa82fead None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=778fb2fe04a242a0a7e4b5b062fc0775, role_id=6caaeeebf7094f598c0e46561cb52144)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:38.014248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee08cc5-64cc-49c4-b471-6bbdaa82fead None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:38.023578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:38.039093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 320/631] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:05:37 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/778fb2fe04a242a0a7e4b5b062fc0775/roles/6caaeeebf7094f598c0e46561cb52144 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:38.040663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08cc5-64cc-49c4-b471-6bbdaa82fead None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:38.085152 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f06ab-3082-440f-9bd6-af27a6ba1f0e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:38.087682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:38.139043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:38.139891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.140174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.141013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.151367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:38.153703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:38.161618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08cc5-64cc-49c4-b471-6bbdaa82fead None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:38.170420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:38.171498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:38.172451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 312/632] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:05:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:38.173037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:38.207160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:38.207788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.208084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.208347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.209627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:38.209934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:38.212263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:38.223635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 321/633] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:38.224660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:38.301615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:38.314186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87054b97-e70b-42fa-ba8e-fa822f4f4970 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:38.344608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172b181-b55d-4155-905b-7b9efe2f00bb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:38.359248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba748-d791-4c52-bfa6-9925d826dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:38.359885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba748-d791-4c52-bfa6-9925d826dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.360182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba748-d791-4c52-bfa6-9925d826dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.360464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba748-d791-4c52-bfa6-9925d826dbe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.374539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cba748-d791-4c52-bfa6-9925d826dbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-15cba748-d791-4c52-bfa6-9925d826dbe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:38.381003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:38.381941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:38.382813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 313/634] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:38.383541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba748-d791-4c52-bfa6-9925d826dbe0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:38.386284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa04ac-6e0f-4278-9765-c966d0401b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:38.387255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa04ac-6e0f-4278-9765-c966d0401b40 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.387739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa04ac-6e0f-4278-9765-c966d0401b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.388208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa04ac-6e0f-4278-9765-c966d0401b40 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.389195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa04ac-6e0f-4278-9765-c966d0401b40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:38.389731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa04ac-6e0f-4278-9765-c966d0401b40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:38.391416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa04ac-6e0f-4278-9765-c966d0401b40 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:38.410070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 322/635] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:38.411250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:38.416240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06eb5-bc80-415e-aa36-36cad759d616 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.416496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06eb5-bc80-415e-aa36-36cad759d616 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.416738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06eb5-bc80-415e-aa36-36cad759d616 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.419045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 323/636] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:38.419045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa06eb5-bc80-415e-aa36-36cad759d616 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:38.495726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba748-d791-4c52-bfa6-9925d826dbe0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:38.533497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:38.534139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.534424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.534702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.536178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa06eb5-bc80-415e-aa36-36cad759d616 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:38.545606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:38.547117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:38.560364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:38.562791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:38.564397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:38.565390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:38.565390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:38.565390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:38.566826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 314/637] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:38.567775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:38.584202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7645173-5edf-449e-8f80-c622eeeb8522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:38.585488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645173-5edf-449e-8f80-c622eeeb8522 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.585790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645173-5edf-449e-8f80-c622eeeb8522 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.586053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645173-5edf-449e-8f80-c622eeeb8522 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.586722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645173-5edf-449e-8f80-c622eeeb8522 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:38.587579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645173-5edf-449e-8f80-c622eeeb8522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:38.589067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645173-5edf-449e-8f80-c622eeeb8522 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:38.603348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 324/638] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:38.604904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829f33b-1068-4eb0-baad-76206290ab49 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.605527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829f33b-1068-4eb0-baad-76206290ab49 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.605807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829f33b-1068-4eb0-baad-76206290ab49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.626481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f829f33b-1068-4eb0-baad-76206290ab49 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:38.627930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f829f33b-1068-4eb0-baad-76206290ab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:38.648364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:38.677736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b784d9-ed7b-48f2-b392-d98000ca15b2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:38.697648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 325/639] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:38.698861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829f33b-1068-4eb0-baad-76206290ab49 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:38.722771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad6a9-f6f8-446a-8025-18f57b4332f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:38.723414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad6a9-f6f8-446a-8025-18f57b4332f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.723690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad6a9-f6f8-446a-8025-18f57b4332f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.723965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad6a9-f6f8-446a-8025-18f57b4332f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.796026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cad6a9-f6f8-446a-8025-18f57b4332f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:38.797486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cad6a9-f6f8-446a-8025-18f57b4332f2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:38.834516 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829f33b-1068-4eb0-baad-76206290ab49 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:38.848815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:38.875096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:38.885303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238c82-8984-491b-a790-559331febf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:38.885919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238c82-8984-491b-a790-559331febf11 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:38.886205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238c82-8984-491b-a790-559331febf11 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:38.886589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8238c82-8984-491b-a790-559331febf11 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:38.887272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238c82-8984-491b-a790-559331febf11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:38.887857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238c82-8984-491b-a790-559331febf11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:38.889069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8238c82-8984-491b-a790-559331febf11 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:38.904489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 315/640] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:38.905586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad6a9-f6f8-446a-8025-18f57b4332f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:38.908173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 326/641] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:38.909679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238c82-8984-491b-a790-559331febf11 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.011204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad6a9-f6f8-446a-8025-18f57b4332f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.026035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8238c82-8984-491b-a790-559331febf11 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.045189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.045825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.046101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.046379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.057239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.058758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.066397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.067455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.067744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.068183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:39.073279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:39.074192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:39.075135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:39.075135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:39.075135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:39.075135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 316/642] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:39.075792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.080920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.082361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:39.094435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:39.095501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 327/643] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:39.096447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.113216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:39.130120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:39.194892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3f9a-dd34-42c5-a0f6-eb21da55ceea None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.206695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84865d8e-13a7-42a0-8011-8b91c18aa400 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.229783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.230418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.230701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.230980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.242726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.244912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.247204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d45650-ab2a-46b1-9ac0-3f7d2a75a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.247837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d45650-ab2a-46b1-9ac0-3f7d2a75a688 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.248119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d45650-ab2a-46b1-9ac0-3f7d2a75a688 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.248392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d45650-ab2a-46b1-9ac0-3f7d2a75a688 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.260328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d45650-ab2a-46b1-9ac0-3f7d2a75a688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:39.260978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:39.261916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:39.262961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:39.262961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:39.262961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-31d45650-ab2a-46b1-9ac0-3f7d2a75a688 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:39.265694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:39.271542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:39.272427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:39.273142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 317/644] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:39.273215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 328/645] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:39.273290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.273360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d45650-ab2a-46b1-9ac0-3f7d2a75a688 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.356607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:39.367680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:39.378208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d45650-ab2a-46b1-9ac0-3f7d2a75a688 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.382041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627d0f2-11f7-4cc3-a019-b58aa6e4fbbe None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.412097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.412830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.413389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.413389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.414131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:39.414445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.416869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.421891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.422500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.422780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.423085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.423727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:39.424036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.425489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.439199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 329/646] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:39.439199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.452954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 318/647] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:39.452954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.547601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2f1dc-fe18-44fd-9bfd-861548fd8921 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.555303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea61d9-22db-49b8-bbcd-a8bc7a3463af None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.583934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.584540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.585082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.585082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.585702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:39.586005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.587538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.597436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.598044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.598324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.598597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.599113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 330/648] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:39.599980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.604002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:39.604325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.605747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.611342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:39.615229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 319/649] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:39.616150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.617873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:39.721981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcba9e6-4bbc-4410-8512-70b37f8d9ba1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.724748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ab07e-7329-47f8-b248-d73984f8cec2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.757566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fe3d-33c8-4cf8-9d9b-00f49696546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.758163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fe3d-33c8-4cf8-9d9b-00f49696546d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.758448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fe3d-33c8-4cf8-9d9b-00f49696546d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.759268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fe3d-33c8-4cf8-9d9b-00f49696546d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.761634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.762452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.762882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.763345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.771142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.772581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:39.784826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:39.785781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 320/650] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:39.786712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.842261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83fe3d-33c8-4cf8-9d9b-00f49696546d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.843745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83fe3d-33c8-4cf8-9d9b-00f49696546d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.850746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:39.857298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:39.895545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b3428-fdc9-4b3d-8d2c-4348c97809b9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:39.933768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:39.934746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:39.935288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:39.935871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:39.945787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:39.947481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:39.951991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 331/651] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:39.952665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fe3d-33c8-4cf8-9d9b-00f49696546d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:39.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:39.966874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:39.968041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 321/652] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:39.968559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.064427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fe3d-33c8-4cf8-9d9b-00f49696546d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.075404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:40.076548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a500-217f-4c45-a6f8-87955754279e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.097938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:40.101982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.102655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.102985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.103235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.115009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.115393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.115915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.116198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.116478 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.116596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.117236 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:40.117551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.119629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:40.135154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:40.136188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:40.137112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:40.137112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:40.137112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:40.138088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 332/653] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:40.139265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.145206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 322/654] 10.222.0.20 () {56 vars in 1139 bytes} [Fri Sep 16 19:05:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:40.146536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.246673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e382fa-abfd-49c6-b9e8-bdd82989d6cf None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.256883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e73e41-382d-4042-9038-b901ee5cd64c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.280641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.281471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.281756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.282034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.291546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.292148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.292423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.292629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.292732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.293363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:40.293667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.294096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.295098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.306715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 323/655] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:40.307548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:40.308290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:40.309380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:40.310323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:40.310323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:40.310323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:40.310323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 333/656] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:40.310547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.328699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:40.351262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:40.411007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2162d-8b00-41fe-bb56-ddbca6bce6c6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.413242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98d1c-7adc-42bd-acd1-5401185891e6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.448918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e1e81-3f1d-4d85-95a9-4ccf858506b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.449351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06172bc1-028e-4eba-bc47-a1e46730b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.449529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e1e81-3f1d-4d85-95a9-4ccf858506b6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.449811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e1e81-3f1d-4d85-95a9-4ccf858506b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.449961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06172bc1-028e-4eba-bc47-a1e46730b76c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.450093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e1e81-3f1d-4d85-95a9-4ccf858506b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.450244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06172bc1-028e-4eba-bc47-a1e46730b76c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.450522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06172bc1-028e-4eba-bc47-a1e46730b76c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.450737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e1e81-3f1d-4d85-95a9-4ccf858506b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:40.451061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e1e81-3f1d-4d85-95a9-4ccf858506b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.452417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e1e81-3f1d-4d85-95a9-4ccf858506b6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.464191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 324/657] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:40.465469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6fbe3-d64e-4580-b8f3-2c8dcc4874e4 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.465755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6fbe3-d64e-4580-b8f3-2c8dcc4874e4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.466092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6fbe3-d64e-4580-b8f3-2c8dcc4874e4 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.467355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 325/658] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:40.471118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6fbe3-d64e-4580-b8f3-2c8dcc4874e4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.521154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06172bc1-028e-4eba-bc47-a1e46730b76c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.522617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06172bc1-028e-4eba-bc47-a1e46730b76c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.536285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:40.573024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:40.578552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6fbe3-d64e-4580-b8f3-2c8dcc4874e4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.612187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.612724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.613002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.613275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.613994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=c915a2b20a2c48a682ef08528e482b96) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:40.614305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.615759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.622103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 326/659] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/role_assignments?user.id=c915a2b20a2c48a682ef08528e482b96&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:40.622874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.628206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 334/660] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:40.629136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06172bc1-028e-4eba-bc47-a1e46730b76c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.741475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06172bc1-028e-4eba-bc47-a1e46730b76c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.746700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57517fc-58de-411b-ad5f-8e9a762eab7c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.759413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:40.783718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.784394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.784680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.784804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39785aa4-7bff-4391-b430-39bf144bb20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.784987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.785405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785aa4-7bff-4391-b430-39bf144bb20b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.785692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785aa4-7bff-4391-b430-39bf144bb20b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.785970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39785aa4-7bff-4391-b430-39bf144bb20b None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.786622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39785aa4-7bff-4391-b430-39bf144bb20b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:40.786930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39785aa4-7bff-4391-b430-39bf144bb20b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.788355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39785aa4-7bff-4391-b430-39bf144bb20b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.793743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:40.795494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:40.802062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 327/661] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:40.803665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f694ae-6b43-4ec9-8be2-a1f49897966d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.803963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f694ae-6b43-4ec9-8be2-a1f49897966d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.804248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f694ae-6b43-4ec9-8be2-a1f49897966d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:40.809401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:40.810335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:40.811295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 335/662] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:40.811916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.828815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-30f694ae-6b43-4ec9-8be2-a1f49897966d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:40.830022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-30f694ae-6b43-4ec9-8be2-a1f49897966d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:40.847978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:40.909314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 328/663] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:40.910552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f694ae-6b43-4ec9-8be2-a1f49897966d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:40.934719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13678a-d5eb-4388-b94c-7917048171cb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:40.979484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:40.981407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:40.982572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:40.983707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:40.998641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.000386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:41.016593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:41.017573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:41.018446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:41.018446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:41.018446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:41.020648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 336/664] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:41.021835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.028935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f694ae-6b43-4ec9-8be2-a1f49897966d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.053668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:41.080431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.081635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.082099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.082455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.091596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.093457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:41.107978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:41.108873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:41.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:41.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:41.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:41.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:41.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:41.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:41.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:41.109767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:41.112056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 329/665] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:41.113122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.131899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:41.151837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56744881-c2e8-458a-9a5e-2388485d7e99 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.190435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.191124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.191326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.191598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.192335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:41.192645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.194078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.212268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 337/666] 10.222.0.20 () {56 vars in 1137 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:41.213290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.232990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ba3eb-933b-411c-b273-4e25977468c6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.268422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.269044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.269327 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.269616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.270256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:41.270560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.271952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.284718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 330/667] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:41.285525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.309748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:41.330161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0cbd6-6925-4997-a6b2-924b03100059 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.364378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:41.366139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.366754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.367040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.367322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.368557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:41.368865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.370316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.388321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 338/668] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:41.389262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.399039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15903b6c-93c9-41cc-afbb-428dacf96c7e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.441442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bd5bc-a07d-4e02-ac1b-0720a34949c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.442027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bd5bc-a07d-4e02-ac1b-0720a34949c0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.442330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bd5bc-a07d-4e02-ac1b-0720a34949c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.442617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bd5bc-a07d-4e02-ac1b-0720a34949c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.454190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bd5bc-a07d-4e02-ac1b-0720a34949c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-975bd5bc-a07d-4e02-ac1b-0720a34949c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:41.459042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:41.459946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:41.460808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 331/669] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:41.461491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bd5bc-a07d-4e02-ac1b-0720a34949c0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.510293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6af59-cbf9-45ac-acb2-9a94c2255e8e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.545265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12abe00-2db9-4567-8539-b76ee27ad4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.545872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12abe00-2db9-4567-8539-b76ee27ad4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.546153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12abe00-2db9-4567-8539-b76ee27ad4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.546437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12abe00-2db9-4567-8539-b76ee27ad4d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.558825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:41.572923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bd5bc-a07d-4e02-ac1b-0720a34949c0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.606472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:41.612448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.613193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.613502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.613760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.619870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12abe00-2db9-4567-8539-b76ee27ad4d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.621038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.621332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12abe00-2db9-4567-8539-b76ee27ad4d4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.622453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:41.635521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:41.636402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:41.637293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 332/670] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:41.637788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.731056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 339/671] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:41.731056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12abe00-2db9-4567-8539-b76ee27ad4d4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.747447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce45282-3af8-424d-9092-92f8fe4520f5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.770471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:41.786228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.786845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.787155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.787433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.788324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=a909fc6177e94d2fa6d38dad285e616a) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:41.788973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.791251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.798046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 333/672] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/role_assignments?user.id=a909fc6177e94d2fa6d38dad285e616a&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:41.798869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.855558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12abe00-2db9-4567-8539-b76ee27ad4d4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.869747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:41.909411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.910878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.911395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.911890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.912777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:41.913903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.916329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.927054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6c8d8-5b44-4063-9e9a-4c5304dcd35f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:41.929359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 340/673] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:41.931080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:41.971355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:41.972121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:41.972471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:41.973046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:41.973613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:41.974016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:41.975613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:41.993057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 334/674] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:41.994281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.065989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b3360-99e1-4719-bfb5-2d808750a47e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.068357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:42.107407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.108043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.108328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.108661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.117412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f32ab3-ebb3-47a7-ad3c-f01b46c2f520 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.121918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:42.122274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:42.139307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:42.139502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:42.140398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:42.141284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:42.141284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:42.141284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:42.141284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 341/675] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:42.141503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.164260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.165111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.166006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.166387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.178731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:42.181974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:42.199167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:42.200344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:42.201501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:42.201501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:42.201501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:42.203222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 335/676] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:42.204151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.270142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdb83e-6872-47ab-9e9b-8748aee25d59 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.319895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.321064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.321986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.322784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.323955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=1c0ab0eca7de4bed89b5f292a52f8c0a) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:42.324415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:42.325687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aca446-2f2f-4f50-85ec-ce8f72a92617 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.326264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:42.334770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 342/677] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:42 2022] GET /identity/v3/role_assignments?user.id=1c0ab0eca7de4bed89b5f292a52f8c0a&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:42.336287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.365981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:42.373807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.374713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.375199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.375833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.376655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:42.377122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:42.379479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:42.399808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 336/678] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:42.401964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.447426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:42.470577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13b280-f033-4fb7-b7c8-c13bddd5ae6e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.511607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.512497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.512870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.513262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.514083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:42.514486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:42.516255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:42.530766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 343/679] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:42.536291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.543839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd131b5-9638-46d2-a675-a99ffb783df9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.651880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:42.656720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.658961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.659829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.660259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.673497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:42.675823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:42.676177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5e174-3123-4a00-8ec3-40feaccb4eea None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:42.692596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:42.693727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:42.694636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:42.694636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:42.694636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:42.694636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:42.694636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:42.694636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:42.694636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:42.694636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:42.697358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 337/680] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:42.705794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.728693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.729369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.729651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.729923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.737399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:42.738948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:42.753071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:42.754293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:42.755648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 344/681] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:42.765335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.820134 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:42.843305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2e95c-0254-4d02-b72c-f28aa24cb717 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.910779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29840c-8fd5-4f8e-a657-e43a8c71aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.911420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29840c-8fd5-4f8e-a657-e43a8c71aa5d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.911701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29840c-8fd5-4f8e-a657-e43a8c71aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.912029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29840c-8fd5-4f8e-a657-e43a8c71aa5d None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.912734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29840c-8fd5-4f8e-a657-e43a8c71aa5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:42.913041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29840c-8fd5-4f8e-a657-e43a8c71aa5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:42.914466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29840c-8fd5-4f8e-a657-e43a8c71aa5d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:42.937068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 338/682] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:42.937855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046f422-d172-4c38-b01b-0ac49dc2cdb1 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.938151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046f422-d172-4c38-b01b-0ac49dc2cdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.938426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046f422-d172-4c38-b01b-0ac49dc2cdb1 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.942306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7238756-6241-40c5-a60e-e54e09eb7f68 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:42.948789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 339/683] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:42.948789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046f422-d172-4c38-b01b-0ac49dc2cdb1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:42.996064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae906f-946e-4299-bfed-ac86d3d172e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:42.996886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae906f-946e-4299-bfed-ac86d3d172e9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:42.997314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae906f-946e-4299-bfed-ac86d3d172e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:42.997689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae906f-946e-4299-bfed-ac86d3d172e9 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:42.998615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae906f-946e-4299-bfed-ac86d3d172e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:42.998931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae906f-946e-4299-bfed-ac86d3d172e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:43.000599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae906f-946e-4299-bfed-ac86d3d172e9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:43.012794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:43.022368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 345/684] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 19:05:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:43.023796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6cb9-253b-4448-8511-552ce7d5c868 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:43.024758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6cb9-253b-4448-8511-552ce7d5c868 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:43.025188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce6cb9-253b-4448-8511-552ce7d5c868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:43.044236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f9ce6cb9-253b-4448-8511-552ce7d5c868 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:43.045697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f9ce6cb9-253b-4448-8511-552ce7d5c868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:43.088067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046f422-d172-4c38-b01b-0ac49dc2cdb1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:43.126491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:43.127193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:43.127631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:43.128008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:43.128834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=1ef7ff56b97e4ca3af05cc407419d906) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:43.129246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:43.130938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:43.143183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 346/686] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:43.143455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 340/686] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:42 2022] GET /identity/v3/role_assignments?user.id=1ef7ff56b97e4ca3af05cc407419d906&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:43.144612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:43.175411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:43.311168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a2d13-ccab-4fb6-9547-727bab70ec3d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:43.358173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36da9bf-b933-4d07-b4ae-64c683337755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:43.358780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da9bf-b933-4d07-b4ae-64c683337755 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:43.359084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da9bf-b933-4d07-b4ae-64c683337755 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:43.359366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da9bf-b933-4d07-b4ae-64c683337755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:43.462978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36da9bf-b933-4d07-b4ae-64c683337755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:43.463206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6cb9-253b-4448-8511-552ce7d5c868 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:43.463319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36da9bf-b933-4d07-b4ae-64c683337755 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:43.488252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:43.600655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 341/687] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:43.606306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36da9bf-b933-4d07-b4ae-64c683337755 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:43.654053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce6cb9-253b-4448-8511-552ce7d5c868 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:43.684281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:43.694121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a17ad-146f-4325-bfdb-82e28b5be753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:43.694835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a17ad-146f-4325-bfdb-82e28b5be753 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:43.695235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a17ad-146f-4325-bfdb-82e28b5be753 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:43.695578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a17ad-146f-4325-bfdb-82e28b5be753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:43.707741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a17ad-146f-4325-bfdb-82e28b5be753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e89a17ad-146f-4325-bfdb-82e28b5be753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:43.713452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:43.714554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:43.715634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:43.716646 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 347/688] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:43.723067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36da9bf-b933-4d07-b4ae-64c683337755 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:43.728083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a17ad-146f-4325-bfdb-82e28b5be753 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:43.738347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:43.763308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:43.763945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:43.764331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:43.764612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:43.776766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:43.778744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:43.794665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:43.796999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:43.799126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:43.799126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:43.799126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:43.799126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 342/689] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:43.808950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:43.927651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a17ad-146f-4325-bfdb-82e28b5be753 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:43.985433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236f39e-9f98-4017-b40c-9d9cee8e662d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:44.007703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:44.009217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.009702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.010177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.011096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:44.011616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:44.013200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:44.027189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 348/690] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:44.029064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:44.030647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:44.031400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.031690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.031970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.032624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:44.032932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:44.034297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:44.058055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 343/691] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:44.063467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:44.088713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:44.107907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:44.158630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509a09-a627-4a15-9dbe-e5c77c7eee3a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:44.203162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:44.204187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.204673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.205149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.225572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:44.228531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:44.237501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1ebe5-3730-4450-a10b-f6e27b261c94 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:44.261133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:44.262228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:44.263149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:44.263149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:44.263149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:44.272821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 349/692] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:44.274610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:44.313936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:44.314931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.315451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.316380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.325005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:44.327192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:44.340952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:44.341891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:44.342846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:44.342846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:44.342846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:44.342846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:44.342846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:44.342846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:44.342846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:44.342846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:44.345451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 344/693] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:44.355681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:44.489365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7655b-2ac1-49c6-af02-0a27bdc62930 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:44.490810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:44.529610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:44.530370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.530656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.530929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.531604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:44.532045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:44.533458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:44.534212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:44.548787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 350/694] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:44.554635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:44.573480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268732-2e9c-4617-8b0a-a98f0fe5e3fa None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:44.634140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe8fa1-8fc0-4dd7-87be-92b188cca3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:44.635287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe8fa1-8fc0-4dd7-87be-92b188cca3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.635810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe8fa1-8fc0-4dd7-87be-92b188cca3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.636303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe8fa1-8fc0-4dd7-87be-92b188cca3e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.637456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe8fa1-8fc0-4dd7-87be-92b188cca3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:44.638399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe8fa1-8fc0-4dd7-87be-92b188cca3e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:44.640462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe8fa1-8fc0-4dd7-87be-92b188cca3e9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:44.655994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 345/695] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:44.657727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5738329-6e87-4b47-aba9-eb9b5f97aeaf None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.658290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5738329-6e87-4b47-aba9-eb9b5f97aeaf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.658778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5738329-6e87-4b47-aba9-eb9b5f97aeaf None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.664540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 346/696] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:44.664540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5738329-6e87-4b47-aba9-eb9b5f97aeaf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:44.691709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd5ab6-58f0-4a68-9b28-528db1a1e5af None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:44.738889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efff2be-c830-42a0-a283-6b581e97478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:44.739635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff2be-c830-42a0-a283-6b581e97478b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.739851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff2be-c830-42a0-a283-6b581e97478b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.740128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efff2be-c830-42a0-a283-6b581e97478b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.748607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efff2be-c830-42a0-a283-6b581e97478b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:44.750088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efff2be-c830-42a0-a283-6b581e97478b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-7efff2be-c830-42a0-a283-6b581e97478b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:44.764223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:44.765254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:44.766872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:44.769976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 351/697] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:05:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:44.771247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1aa3-f8b4-4186-a356-246ce1f63f22 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.771538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1aa3-f8b4-4186-a356-246ce1f63f22 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.771834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1aa3-f8b4-4186-a356-246ce1f63f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.791022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4bdc1aa3-f8b4-4186-a356-246ce1f63f22 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:44.792290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4bdc1aa3-f8b4-4186-a356-246ce1f63f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:44.796032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5738329-6e87-4b47-aba9-eb9b5f97aeaf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:44.809935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:44.844836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:44.845979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.846596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.847137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.848165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=778fb2fe04a242a0a7e4b5b062fc0775) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:44.848696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:44.851161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:44.858846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 347/698] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:44 2022] GET /identity/v3/role_assignments?user.id=778fb2fe04a242a0a7e4b5b062fc0775&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:44.859898 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:44.871744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 352/699] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:44.873312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0144-7d68-41ae-a1da-89aac8d87379 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.873611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0144-7d68-41ae-a1da-89aac8d87379 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.873892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0144-7d68-41ae-a1da-89aac8d87379 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.875716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 353/700] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:44.878852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:44.881399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46262826-f30e-4a14-82ae-386bca3ff1f8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:44.882269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46262826-f30e-4a14-82ae-386bca3ff1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:44.882686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46262826-f30e-4a14-82ae-386bca3ff1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:44.905493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-46262826-f30e-4a14-82ae-386bca3ff1f8 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:44.907681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-46262826-f30e-4a14-82ae-386bca3ff1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:45.039434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 354/701] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:45.076457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb769f-5287-41d3-ab34-2528195fff67 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.114327 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:45.114941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:45.115250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:45.115526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:45.116255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:45.116566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:45.118562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:45.136504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 348/702] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:05:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:45.141947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46262826-f30e-4a14-82ae-386bca3ff1f8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:45.178810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:45.246825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:45.261967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:45.270421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46262826-f30e-4a14-82ae-386bca3ff1f8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.307752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698efb3-3099-4fd4-aae3-afbbe37ce79a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.315712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185e3a1-7b8d-4d4b-8c07-54c1310f7532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:45.316415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e3a1-7b8d-4d4b-8c07-54c1310f7532 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:45.317221 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e3a1-7b8d-4d4b-8c07-54c1310f7532 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:45.317503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e3a1-7b8d-4d4b-8c07-54c1310f7532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:45.352439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:45.353080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:45.353361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:45.353901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:45.365653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:45.367122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:45.387119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:45.388212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:45.389099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:45.389099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:45.389099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:45.389099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 349/703] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:45.389880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:45.403159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185e3a1-7b8d-4d4b-8c07-54c1310f7532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:45.404569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185e3a1-7b8d-4d4b-8c07-54c1310f7532 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:45.496577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:45.518862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec8a51-a28a-4fa8-99cf-a22010638631 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.519227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 355/704] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:45.520180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185e3a1-7b8d-4d4b-8c07-54c1310f7532 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:45.540590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:45.563330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:45.564258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:45.564717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:45.565232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:45.565965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:45.567619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:45.580899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:45.582167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:45.583119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:45.584438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 350/705] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:45 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:45.585906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:45.633032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185e3a1-7b8d-4d4b-8c07-54c1310f7532 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.669612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:45.670266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:45.670553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:45.670830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:45.671550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:45.671811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:45.673370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:45.690215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 356/706] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:45.691163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:45.713786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dfb61-9b6f-401d-833e-dcf7e54665b7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.736984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:45.762908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:45.764324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:45.764836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:45.765890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:45.779826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:45.782343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:45.800879 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1b405-b4d0-41a3-9380-a5607addd6db None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:45.802214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:45.803676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:45.804762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:45.804762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:45.804762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:45.808214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 351/707] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:45.809185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:45.845695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:45.847036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:45.847720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:45.848173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:45.849198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] RBAC: Adding query filter params (name=network) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:45.849650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:45.852178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:45.853922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:45.860243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 357/708] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:05:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:45.862444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:45.950092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d25e03-b7f9-47cb-9701-a3b002b4d3bc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.983459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350442bf-d273-4c20-8791-0272448a9542 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:45.991602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:45.998439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5d1b5-46e4-4ca5-87fe-43c7463b55a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:45.999084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5d1b5-46e4-4ca5-87fe-43c7463b55a6 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:45.999622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5d1b5-46e4-4ca5-87fe-43c7463b55a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:45.999903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5d1b5-46e4-4ca5-87fe-43c7463b55a6 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.001025 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5d1b5-46e4-4ca5-87fe-43c7463b55a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:46.002743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5d1b5-46e4-4ca5-87fe-43c7463b55a6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:46.022379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c7063-eeec-4ff6-b2fe-823fe1a26d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:46.023116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c7063-eeec-4ff6-b2fe-823fe1a26d28 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:46.023470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c7063-eeec-4ff6-b2fe-823fe1a26d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:46.023835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c7063-eeec-4ff6-b2fe-823fe1a26d28 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.024626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c7063-eeec-4ff6-b2fe-823fe1a26d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:46.024993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c7063-eeec-4ff6-b2fe-823fe1a26d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:46.026481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c7063-eeec-4ff6-b2fe-823fe1a26d28 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:46.027695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 352/709] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:05:45 2022] POST /identity/v3/users => generated 254 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:46.028469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5d1b5-46e4-4ca5-87fe-43c7463b55a6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:46.055955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 358/710] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:46.058594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effee18f-db2a-4a1d-8ab5-717b70d3da6d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:46.059662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effee18f-db2a-4a1d-8ab5-717b70d3da6d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:46.060092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effee18f-db2a-4a1d-8ab5-717b70d3da6d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.066510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 359/711] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:46.066510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effee18f-db2a-4a1d-8ab5-717b70d3da6d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:46.148877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:46.159955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5d1b5-46e4-4ca5-87fe-43c7463b55a6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:46.188076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effee18f-db2a-4a1d-8ab5-717b70d3da6d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:46.198642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01674cec-d04a-452e-a7ab-349e43cb9c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:46.199582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674cec-d04a-452e-a7ab-349e43cb9c4d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:46.200005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674cec-d04a-452e-a7ab-349e43cb9c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:46.200453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01674cec-d04a-452e-a7ab-349e43cb9c4d None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.201266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01674cec-d04a-452e-a7ab-349e43cb9c4d None admin] RBAC: Adding query filter params (type=network) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:46.201744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01674cec-d04a-452e-a7ab-349e43cb9c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:46.203424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01674cec-d04a-452e-a7ab-349e43cb9c4d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:46.219289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 353/712] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:05:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:46.221073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac212c-f9fa-44ca-a13d-ea857dfaeae5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:46.221559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac212c-f9fa-44ca-a13d-ea857dfaeae5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:46.221836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac212c-f9fa-44ca-a13d-ea857dfaeae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.231901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:46.232546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:46.232828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:46.233101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.240621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:46.242056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:46.256168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-72ac212c-f9fa-44ca-a13d-ea857dfaeae5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:46.256397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:46.257227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:46.259443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:46.259443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:46.259443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:46.259443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:46.259443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:46.259443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:46.259443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:46.259443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:46.259883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-72ac212c-f9fa-44ca-a13d-ea857dfaeae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:46.259956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 360/713] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:46.263963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:46.307921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:46.348402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 354/714] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:46.401460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70fedf-e6c8-48b3-836b-ee55f3b2a9f7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:46.441186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:46.442074 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:46.442567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:46.443183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.444172 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:46.444587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:46.446931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:46.460462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 361/715] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:46.466171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac212c-f9fa-44ca-a13d-ea857dfaeae5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:46.558646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:46.576820 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac212c-f9fa-44ca-a13d-ea857dfaeae5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:46.612875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:46.613657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:46.614054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:46.614439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.615315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=c915a2b20a2c48a682ef08528e482b96) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:46.615744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:46.617337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:46.624248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 355/716] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:46 2022] GET /identity/v3/role_assignments?user.id=c915a2b20a2c48a682ef08528e482b96&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0f99070a6a88400199520fccd98977b6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:46.740272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:46.839100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:46.855755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e97f0-9b68-430d-a8ce-dd8b461d674b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:46.900082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:46.900726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:46.901010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:46.901285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:46.901881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:46.903268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:46.914328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:46.916380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:46.917211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 362/717] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 16 19:05:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:46.923699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:47.075377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5d1c6-2cd9-4b9e-ad38-511ab8ba2bdd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:47.119931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e5e16-4e01-4c31-b4a0-12ae5daaac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:47.120553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5e16-4e01-4c31-b4a0-12ae5daaac6e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:47.120836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5e16-4e01-4c31-b4a0-12ae5daaac6e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:47.121109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e5e16-4e01-4c31-b4a0-12ae5daaac6e None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:47.121743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5e16-4e01-4c31-b4a0-12ae5daaac6e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:47.122048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5e16-4e01-4c31-b4a0-12ae5daaac6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:47.123444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e5e16-4e01-4c31-b4a0-12ae5daaac6e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:47.128330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 356/718] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 19:05:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:47.134274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:47.303052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0d46b-4651-4fd2-b3fd-04c6795f4835 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:47.354170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbfc6d-bf8c-4ab6-b394-3f57c3e611fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:47.354715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbfc6d-bf8c-4ab6-b394-3f57c3e611fd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:47.355016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbfc6d-bf8c-4ab6-b394-3f57c3e611fd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:47.355290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbfc6d-bf8c-4ab6-b394-3f57c3e611fd None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:47.355945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbfc6d-bf8c-4ab6-b394-3f57c3e611fd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:47.356253 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbfc6d-bf8c-4ab6-b394-3f57c3e611fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:47.357682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbfc6d-bf8c-4ab6-b394-3f57c3e611fd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:47.367423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 363/719] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 19:05:47 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:47.506576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c1a14-a50e-4dea-add8-4055307e166e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:47.506911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c1a14-a50e-4dea-add8-4055307e166e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:47.507174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c1a14-a50e-4dea-add8-4055307e166e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:47.509371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 357/720] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:47.515213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203622f3-4be3-4760-94c1-5d7a2a1b4659 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:47.515503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203622f3-4be3-4760-94c1-5d7a2a1b4659 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:47.515785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203622f3-4be3-4760-94c1-5d7a2a1b4659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:47.545061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-203622f3-4be3-4760-94c1-5d7a2a1b4659 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:47.546233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-203622f3-4be3-4760-94c1-5d7a2a1b4659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:47.565987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:47.655167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 364/721] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:47.952046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c1a14-a50e-4dea-add8-4055307e166e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:47.973201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:48.096405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c1a14-a50e-4dea-add8-4055307e166e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:48.147432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62bb0d-5f6b-46a9-9d4a-38efba3b3a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:48.148059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62bb0d-5f6b-46a9-9d4a-38efba3b3a8c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:48.148335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62bb0d-5f6b-46a9-9d4a-38efba3b3a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:48.148610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62bb0d-5f6b-46a9-9d4a-38efba3b3a8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:48.167831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62bb0d-5f6b-46a9-9d4a-38efba3b3a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-db62bb0d-5f6b-46a9-9d4a-38efba3b3a8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:48.173021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:48.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:48.174842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 358/722] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:48.184100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203622f3-4be3-4760-94c1-5d7a2a1b4659 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:48.318385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203622f3-4be3-4760-94c1-5d7a2a1b4659 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:48.356176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:48.356797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:48.357088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:48.357367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:48.358037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:48.358343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:48.359796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:48.369153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 365/723] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:48.374481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62bb0d-5f6b-46a9-9d4a-38efba3b3a8c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:48.524107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:48.569504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62bb0d-5f6b-46a9-9d4a-38efba3b3a8c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:48.620675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:48.621321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:48.621602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:48.621876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:48.635522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:48.637006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:48.658308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:48.659363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:48.660387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:48.660387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:48.660387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:48.660387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 359/724] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:48.668161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:48.682745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:48.811374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4544d-d465-4fd5-b380-1661d01fd3ad None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:48.848087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2334f5-b4e8-4e84-a195-9b2a626d2a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:48.848624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2334f5-b4e8-4e84-a195-9b2a626d2a33 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:48.848908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2334f5-b4e8-4e84-a195-9b2a626d2a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:48.849187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2334f5-b4e8-4e84-a195-9b2a626d2a33 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:48.849835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2334f5-b4e8-4e84-a195-9b2a626d2a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:48.850139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2334f5-b4e8-4e84-a195-9b2a626d2a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:48.851886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2334f5-b4e8-4e84-a195-9b2a626d2a33 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:48.864918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 366/725] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:48.870711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:48.906867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40638b-1348-4ebf-bace-5f3ed2b41f07 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:48.907260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40638b-1348-4ebf-bace-5f3ed2b41f07 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:48.907483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40638b-1348-4ebf-bace-5f3ed2b41f07 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:48.908793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 367/726] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:48.924375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348e35b-78d5-4b23-a6c6-842e0085da80 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:48.924645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348e35b-78d5-4b23-a6c6-842e0085da80 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:48.924919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348e35b-78d5-4b23-a6c6-842e0085da80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:48.956777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3348e35b-78d5-4b23-a6c6-842e0085da80 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:48.957999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3348e35b-78d5-4b23-a6c6-842e0085da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:49.057062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e7c4e-92fe-4d1e-a214-ee9718f334e8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:49.087732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:49.102327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 368/727] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 19:05:49.105736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:49.123805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb6fa5-73c7-48c4-ace8-6f25d3cdd3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:49.124459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6fa5-73c7-48c4-ace8-6f25d3cdd3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.124745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6fa5-73c7-48c4-ace8-6f25d3cdd3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.125031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6fa5-73c7-48c4-ace8-6f25d3cdd3b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.140204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb6fa5-73c7-48c4-ace8-6f25d3cdd3b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:49.141706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb6fa5-73c7-48c4-ace8-6f25d3cdd3b8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-60eb6fa5-73c7-48c4-ace8-6f25d3cdd3b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:49.154984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:49.157233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:49.159251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 360/728] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:49.161836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348e35b-78d5-4b23-a6c6-842e0085da80 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:49.285038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028fa3f-b84e-4cb2-943d-be69f949d350 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.285391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028fa3f-b84e-4cb2-943d-be69f949d350 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.285564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028fa3f-b84e-4cb2-943d-be69f949d350 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.287378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 361/729] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:49.299435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44a2a-9a19-4ab8-a265-432dd22622f7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.299758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44a2a-9a19-4ab8-a265-432dd22622f7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.300048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c44a2a-9a19-4ab8-a265-432dd22622f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.327206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e4c44a2a-9a19-4ab8-a265-432dd22622f7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:49.329949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e4c44a2a-9a19-4ab8-a265-432dd22622f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:49.337025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348e35b-78d5-4b23-a6c6-842e0085da80 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:49.407013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a43e3-de83-48d4-9109-94f051dfd45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:49.407557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a43e3-de83-48d4-9109-94f051dfd45d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.407835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a43e3-de83-48d4-9109-94f051dfd45d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.408113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a43e3-de83-48d4-9109-94f051dfd45d None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.408853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a43e3-de83-48d4-9109-94f051dfd45d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:49.409268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a43e3-de83-48d4-9109-94f051dfd45d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:49.410600 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a43e3-de83-48d4-9109-94f051dfd45d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:49.423047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 362/730] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:49.423047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c44a2a-9a19-4ab8-a265-432dd22622f7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:49.432797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 369/731] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 19:05:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:49.432797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486edf-7f9a-4dc5-b726-a32a9ab9f983 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.432797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486edf-7f9a-4dc5-b726-a32a9ab9f983 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.433347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78486edf-7f9a-4dc5-b726-a32a9ab9f983 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.439521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 370/732] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:49.439521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78486edf-7f9a-4dc5-b726-a32a9ab9f983 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:49.514563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:49.550530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c44a2a-9a19-4ab8-a265-432dd22622f7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:49.564103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78486edf-7f9a-4dc5-b726-a32a9ab9f983 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:49.570756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:49.598087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51a5bb-bc9b-4999-a834-8d77daf86308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:49.598881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a5bb-bc9b-4999-a834-8d77daf86308 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.599338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a5bb-bc9b-4999-a834-8d77daf86308 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.599750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a5bb-bc9b-4999-a834-8d77daf86308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.606293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80e22-7432-406f-8a82-0c115bfb198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:49.607241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80e22-7432-406f-8a82-0c115bfb198b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.607792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80e22-7432-406f-8a82-0c115bfb198b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.608285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a80e22-7432-406f-8a82-0c115bfb198b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.611785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51a5bb-bc9b-4999-a834-8d77daf86308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-8f51a5bb-bc9b-4999-a834-8d77daf86308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:49.618687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:49.619633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:49.620484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 363/733] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:49.621656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e411f-6b48-4055-8e95-71fd88c9b429 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.621752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e411f-6b48-4055-8e95-71fd88c9b429 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.621957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e411f-6b48-4055-8e95-71fd88c9b429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.647413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6f2e411f-6b48-4055-8e95-71fd88c9b429 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:49.648676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6f2e411f-6b48-4055-8e95-71fd88c9b429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:49.691372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a80e22-7432-406f-8a82-0c115bfb198b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:49.693228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a80e22-7432-406f-8a82-0c115bfb198b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:49.729932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 364/734] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:49.730849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e411f-6b48-4055-8e95-71fd88c9b429 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:49.765110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:49.826143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 371/735] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 19:05:49.827235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80e22-7432-406f-8a82-0c115bfb198b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:49.852782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e411f-6b48-4055-8e95-71fd88c9b429 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:49.856505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:49.898112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:49.899865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.900153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.900429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.901131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:49.901442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:49.902859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:49.917558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 365/736] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:49.919403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:49.945328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a80e22-7432-406f-8a82-0c115bfb198b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:49.984079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e1d5-c366-474c-bf10-d8f4af275f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:49.984726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e1d5-c366-474c-bf10-d8f4af275f80 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:49.985008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e1d5-c366-474c-bf10-d8f4af275f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:49.985337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415e1d5-c366-474c-bf10-d8f4af275f80 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:49.986149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415e1d5-c366-474c-bf10-d8f4af275f80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:49.987646 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415e1d5-c366-474c-bf10-d8f4af275f80 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.010111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 372/737] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:05:49 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:50.011220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e1d5-c366-474c-bf10-d8f4af275f80 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.035746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:50.044321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4be11-4df6-4fba-9e01-6f5d67966ca4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.099222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89f0b8-fd62-454d-abe3-ea5165f2fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.099915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89f0b8-fd62-454d-abe3-ea5165f2fb09 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.100169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89f0b8-fd62-454d-abe3-ea5165f2fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.100409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89f0b8-fd62-454d-abe3-ea5165f2fb09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.113971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89f0b8-fd62-454d-abe3-ea5165f2fb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.115497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89f0b8-fd62-454d-abe3-ea5165f2fb09 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ed89f0b8-fd62-454d-abe3-ea5165f2fb09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:50.131505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:50.132554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:50.133539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:50.133539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:50.133539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:50.138015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 366/738] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:50.139150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b29e-e5c2-4288-9d29-8d329661d73f None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.139439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b29e-e5c2-4288-9d29-8d329661d73f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.139716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223b29e-e5c2-4288-9d29-8d329661d73f None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.141068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 367/739] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:50.141786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223b29e-e5c2-4288-9d29-8d329661d73f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.147267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415e1d5-c366-474c-bf10-d8f4af275f80 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.161207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:50.185205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.186123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.186406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.186681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.198158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.199780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:50.216889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:50.217850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:50.218733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:50.218733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:50.218733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:50.218733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 373/740] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:50.218951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.267461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223b29e-e5c2-4288-9d29-8d329661d73f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.293093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:50.302677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e20ad9-aecc-43c4-95f9-83861e99d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.303345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20ad9-aecc-43c4-95f9-83861e99d38d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.303631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20ad9-aecc-43c4-95f9-83861e99d38d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.303911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e20ad9-aecc-43c4-95f9-83861e99d38d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.315704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e20ad9-aecc-43c4-95f9-83861e99d38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-83e20ad9-aecc-43c4-95f9-83861e99d38d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:50.320488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:50.322091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:50.322943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 368/741] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:50.323675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507b1-e099-45a5-ad1e-05fa9128185d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.323675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507b1-e099-45a5-ad1e-05fa9128185d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.324308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507b1-e099-45a5-ad1e-05fa9128185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.339562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a95a3a-413c-4dd4-b7f8-f333eb120421 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.342791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-313507b1-e099-45a5-ad1e-05fa9128185d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:50.344053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-313507b1-e099-45a5-ad1e-05fa9128185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:50.375939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.376557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.376835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.377108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.377754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:50.378063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.379471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.392366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 374/742] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:50.393487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.419697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 369/743] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:50 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 19:05:50.420854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313507b1-e099-45a5-ad1e-05fa9128185d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.434787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:50.537572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313507b1-e099-45a5-ad1e-05fa9128185d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.542600 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf741d-3c06-4523-84d0-7d27441f2543 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.576764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:50.577889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.578629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.579132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.579408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.580229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:50.580665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.582264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.589401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.590501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.590940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.591384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.592179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 370/744] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:50.592402 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:50.592849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.593258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.594658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.612022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 375/745] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:50.613133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.674555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:50.714930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b86483-6b5f-4bfa-8ed6-07c10a67f73d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.724583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3409824-806f-4566-800e-83352a8bf41d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.753098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.753842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.754123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.754399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.761346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.762768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.762900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.763694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.764125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.764641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:50.774093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:50.775239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:50.776187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 371/746] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:50.776679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.782385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.784073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:50.800579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:50.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:50.802900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:50.802900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:50.802900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:50.809143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 376/747] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:50.809143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.854229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:50.885397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2826c-2e41-41c9-b1d7-f9415fbd85f4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.910076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:50.920448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.921184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.921489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7c2ab-b8ce-47c4-813a-4bb6241371ef None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:50.921588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.921914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.932000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.934239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:50.948346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:50.949529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:05:50.950665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:50.951489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 372/748] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:50.955897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:50.965279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8f85d-7837-4381-a352-b3859670dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:50.965897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f85d-7837-4381-a352-b3859670dbf2 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:50.966175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f85d-7837-4381-a352-b3859670dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:50.966444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8f85d-7837-4381-a352-b3859670dbf2 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:50.967122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8f85d-7837-4381-a352-b3859670dbf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:50.968488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8f85d-7837-4381-a352-b3859670dbf2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:50.984758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 377/749] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:05:50 2022] POST /identity/v3/services => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:50.985914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8f85d-7837-4381-a352-b3859670dbf2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:51.094578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b351c-593b-4a13-9d14-6f89eddeb9a5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:51.138319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:51.139175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:51.139553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:51.139926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:51.140732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:51.141144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:51.142698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:51.146361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:51.154015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8f85d-7837-4381-a352-b3859670dbf2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:51.164496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 373/750] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:51.166140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:51.200359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:51.201250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:51.201535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:51.201812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:51.202461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:51.202926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:51.205685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:51.213958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:51.219787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 378/751] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:51.221583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:51.286792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc676c9-c56b-4218-b3b7-ebe5c73378c5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:51.328353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:51.329211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:51.329636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:51.330080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:51.331103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:51.331573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:51.333264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:51.358685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 374/752] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 19:05:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:51.358685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:51.364018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc11130-0f94-46bf-aec1-72160c8c144b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:51.411465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:51.412689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:51.413623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:51.414825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:51.416089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=778fb2fe04a242a0a7e4b5b062fc0775) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:51.417008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:51.418683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:51.435486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 379/753] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:51 2022] GET /identity/v3/role_assignments?user.id=778fb2fe04a242a0a7e4b5b062fc0775&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0f99070a6a88400199520fccd98977b6 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:51.436881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:51.491550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:51.521831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:51.526180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c90698-0f67-420c-a537-01d247e00bb9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:51.596771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:51.597425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:51.597706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:51.597982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:51.610692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:51.613290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:51.638335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:51.639554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:51.640573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:51.641128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 375/754] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:05:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:51.647586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:51.651437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11e9c2-0726-4b2f-9108-4da39e6a99a2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:51.688820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c5701-5f9c-4b23-8d5c-3ff5e4195157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:51.689681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c5701-5f9c-4b23-8d5c-3ff5e4195157 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:51.690111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c5701-5f9c-4b23-8d5c-3ff5e4195157 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:51.690536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c5701-5f9c-4b23-8d5c-3ff5e4195157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:51.765470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c5701-5f9c-4b23-8d5c-3ff5e4195157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:51.767194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c5701-5f9c-4b23-8d5c-3ff5e4195157 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:51.792675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:51.875137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 380/755] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:05:51.884784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c5701-5f9c-4b23-8d5c-3ff5e4195157 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:51.902904 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa4faf-99c4-42e2-b5e1-a3c405afb526 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:51.972775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:51.973594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:51.973978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:51.974352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:51.975214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:51.975621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:51.977624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:52.007329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c5701-5f9c-4b23-8d5c-3ff5e4195157 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:52.018943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 376/756] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:05:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:52.037717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:52.038549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:52.062731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:52.075805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:52.076464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.076746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.077023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.100073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:52.101852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:52.131143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:52.132116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:52.132991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:52.132991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:52.132991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:52.140827 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 381/757] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:52.148468 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:52.176868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1784530-493e-4f06-89e7-4dad004e60c2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:52.221675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:52.222685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.223207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.223685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.241311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:52.243683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:52.272671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:52.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:52.274713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:52.274713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:52.274713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:52.283916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 377/758] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:52.291968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:52.347028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c834d5-12e8-4545-97e6-2ac49e873202 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:52.375114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:52.390023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fea567-37c4-4616-a630-f4b4518522b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:52.391011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea567-37c4-4616-a630-f4b4518522b0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.391309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea567-37c4-4616-a630-f4b4518522b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.391583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fea567-37c4-4616-a630-f4b4518522b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.392514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fea567-37c4-4616-a630-f4b4518522b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:52.392819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fea567-37c4-4616-a630-f4b4518522b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:52.394939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fea567-37c4-4616-a630-f4b4518522b0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:52.406749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ee29d-acf6-4ac8-9d36-e073abaa90d6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:52.409747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 382/759] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:52.411082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7fbeb-6518-4225-b818-01f1fb32de6c None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.411367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7fbeb-6518-4225-b818-01f1fb32de6c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.411642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7fbeb-6518-4225-b818-01f1fb32de6c None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.417901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 383/760] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:52.418722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7fbeb-6518-4225-b818-01f1fb32de6c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:52.459705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d3669-2e06-4ba9-987a-253de8ebe5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:52.460632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3669-2e06-4ba9-987a-253de8ebe5af None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.461181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3669-2e06-4ba9-987a-253de8ebe5af None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.461881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d3669-2e06-4ba9-987a-253de8ebe5af None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.462746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d3669-2e06-4ba9-987a-253de8ebe5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:52.462853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:52.463389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d3669-2e06-4ba9-987a-253de8ebe5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:52.465050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d3669-2e06-4ba9-987a-253de8ebe5af None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:52.480556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 378/761] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:52.482153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b55f6c-0da2-4930-a18b-ac98b0fef650 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.482665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b55f6c-0da2-4930-a18b-ac98b0fef650 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.483207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b55f6c-0da2-4930-a18b-ac98b0fef650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.504369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a6b55f6c-0da2-4930-a18b-ac98b0fef650 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:52.506497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a6b55f6c-0da2-4930-a18b-ac98b0fef650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:52.535806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7fbeb-6518-4225-b818-01f1fb32de6c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:52.573800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:52.574423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.574757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.575059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.584089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:52.585807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:52.589557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 379/762] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:05:52.590645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b55f6c-0da2-4930-a18b-ac98b0fef650 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:52.612469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:52.613417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:52.614292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:52.614292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:52.614292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:52.614292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:52.614292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:52.614292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:52.614292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:52.614292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:52.619246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 384/763] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:52.623651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:52.710870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:52.786181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b55f6c-0da2-4930-a18b-ac98b0fef650 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:52.806728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767d582-302a-4136-b910-62f395b819d5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:52.831353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:52.846402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:52.847526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.848023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.848519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.857204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:52.858777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:52.872929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:52.874024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:52.875119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:52.875119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:52.875119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:52.875119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:52.875119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:52.875119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:52.875119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:52.875119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:52.875692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:52.879015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:52.879015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:52.879184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 380/764] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:52.879256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:52.879256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:52.879256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:52.879461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:52.887793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:52.898586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 385/765] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:52.904817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:53.007230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c340a-5dcb-45b1-bdf0-781912b1c8d0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:53.029457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:53.031184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbb451-7e55-4c4f-b3f6-696542c0671e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:53.045174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:53.045873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.046222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.046568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.047368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:53.047755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:53.049256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:53.062843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 381/766] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:53.063946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:53.073893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:53.074757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.075249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.076022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.076924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=09a4d22349684197b39b673845815054) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:53.077509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:53.079288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:53.085950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 386/767] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:05:52 2022] GET /identity/v3/role_assignments?user.id=09a4d22349684197b39b673845815054&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:53.087280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:53.109635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:53.174034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbd197-a143-4e0d-9292-af216c7f671b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:53.219269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:53.219907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.220170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.223032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.223032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:53.223032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:53.227761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a399fb-be38-42c9-a32a-8437abfeb89e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:53.245476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:53.246532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:53.247430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:53.250965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 382/768] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:53 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:53.262684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:53.319754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0cc1b-afc2-40cf-8577-046a8cf840cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:53.320559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0cc1b-afc2-40cf-8577-046a8cf840cd None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.321005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0cc1b-afc2-40cf-8577-046a8cf840cd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.321501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0cc1b-afc2-40cf-8577-046a8cf840cd None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/c915a2b20a2c48a682ef08528e482b96/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.326220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0cc1b-afc2-40cf-8577-046a8cf840cd None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=c915a2b20a2c48a682ef08528e482b96, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:53.327711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0cc1b-afc2-40cf-8577-046a8cf840cd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:53.347031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:53.352571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 387/769] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:05:53 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/c915a2b20a2c48a682ef08528e482b96/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:53.385817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145536e5-3c43-4fdf-bf7e-f2e60a73d2a4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:53.423696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a777bc-bb02-41de-8bfb-b32a26549736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:53.424319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a777bc-bb02-41de-8bfb-b32a26549736 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.424595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a777bc-bb02-41de-8bfb-b32a26549736 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.424866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a777bc-bb02-41de-8bfb-b32a26549736 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.425502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a777bc-bb02-41de-8bfb-b32a26549736 None admin] RBAC: Adding query filter params (name=network) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:53.425802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a777bc-bb02-41de-8bfb-b32a26549736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:53.429563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a777bc-bb02-41de-8bfb-b32a26549736 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:53.434682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 383/770] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:05:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:53.440010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0cc1b-afc2-40cf-8577-046a8cf840cd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:53.592680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:53.619817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0cc1b-afc2-40cf-8577-046a8cf840cd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:53.635857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad69f-552e-474e-8a40-1898ff0d9020 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.636468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad69f-552e-474e-8a40-1898ff0d9020 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.636952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad69f-552e-474e-8a40-1898ff0d9020 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.638780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 384/771] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:53.644426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472844a3-0772-4326-a140-e252f8d34fd9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.647412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472844a3-0772-4326-a140-e252f8d34fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.647713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472844a3-0772-4326-a140-e252f8d34fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.665452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:53.666465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.667508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.668008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.668865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] RBAC: Adding query filter params (type=network) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:53.669371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:53.671210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:53.676488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-472844a3-0772-4326-a140-e252f8d34fd9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:53.677586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 388/772] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:05:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:53.677763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-472844a3-0772-4326-a140-e252f8d34fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:53.683192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:53.776633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 385/773] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:05:53.836064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19e3c9-7577-443c-aa6c-3cd6b626204c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:53.874898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedf17f-e304-4659-afb0-de3ee2b1c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:53.875576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedf17f-e304-4659-afb0-de3ee2b1c0bf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:53.875853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedf17f-e304-4659-afb0-de3ee2b1c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:53.876183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedf17f-e304-4659-afb0-de3ee2b1c0bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:53.876882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedf17f-e304-4659-afb0-de3ee2b1c0bf None admin] RBAC: Adding query filter params (interface=public, service_id=1a8ddb9670354b4dabfc84603a7b1bc4, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:53.877229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedf17f-e304-4659-afb0-de3ee2b1c0bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:53.878662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedf17f-e304-4659-afb0-de3ee2b1c0bf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:53.887460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 389/774] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 19:05:53 2022] GET /identity/v3/endpoints?service_id=1a8ddb9670354b4dabfc84603a7b1bc4&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:53.896100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472844a3-0772-4326-a140-e252f8d34fd9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:53.950183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:54.032785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472844a3-0772-4326-a140-e252f8d34fd9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:54.076578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f3f93-ad9c-48cb-a618-d94ff6501363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:54.077232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3f93-ad9c-48cb-a618-d94ff6501363 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:54.077515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3f93-ad9c-48cb-a618-d94ff6501363 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:54.077838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f3f93-ad9c-48cb-a618-d94ff6501363 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:54.078454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f3f93-ad9c-48cb-a618-d94ff6501363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:54.079839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f3f93-ad9c-48cb-a618-d94ff6501363 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:54.085620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 386/775] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:05:53 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:54.121572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e19b4-7b95-41a3-9e98-8bcc7cd13514 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:54.121572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e19b4-7b95-41a3-9e98-8bcc7cd13514 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:54.121572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e19b4-7b95-41a3-9e98-8bcc7cd13514 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:54.122483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 390/776] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:54.128570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a894b-1d59-4653-b279-3f3b1d2fac23 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:54.129175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a894b-1d59-4653-b279-3f3b1d2fac23 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:54.129667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a894b-1d59-4653-b279-3f3b1d2fac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:54.160268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4e8a894b-1d59-4653-b279-3f3b1d2fac23 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:54.161926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4e8a894b-1d59-4653-b279-3f3b1d2fac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:54.199855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e19b4-7b95-41a3-9e98-8bcc7cd13514 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:54.215606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:54.375687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 387/777] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:05:54.405127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e19b4-7b95-41a3-9e98-8bcc7cd13514 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:54.446417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:54.447160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:54.447385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:54.447665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:54.448265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:54.449650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:54.459035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:54.460024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:54.461313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 391/778] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 16 19:05:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:54.468106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a894b-1d59-4653-b279-3f3b1d2fac23 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:54.507824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:54.604132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a894b-1d59-4653-b279-3f3b1d2fac23 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:54.650889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:54.651535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:54.651816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:54.652091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:54.652737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:54.653045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:54.654411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:54.655851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:54.663349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 388/779] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 19:05:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:54.670080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:54.743553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:54.804644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4690018-ea5a-4ee4-9be6-7ea6f6ce694a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:54.827031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:54.835987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050d1b0-8de2-457e-9a21-9128637b6708 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:54.866720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0514b-0b0d-4bd7-a2b5-37337d6c6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:54.867921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0514b-0b0d-4bd7-a2b5-37337d6c6376 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:54.868219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0514b-0b0d-4bd7-a2b5-37337d6c6376 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:54.868495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0514b-0b0d-4bd7-a2b5-37337d6c6376 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:54.880739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0514b-0b0d-4bd7-a2b5-37337d6c6376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-bbe0514b-0b0d-4bd7-a2b5-37337d6c6376 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:54.886378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:54.887353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:54.888182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 392/780] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:54.894240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0514b-0b0d-4bd7-a2b5-37337d6c6376 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:54.908563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:54.909111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:54.909393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:54.909673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:54.910313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:54.910621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:54.912009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:54.921554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 389/781] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 19:05:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:54.928759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:55.109080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0514b-0b0d-4bd7-a2b5-37337d6c6376 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:55.130487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0846c-00f2-468d-87e5-f6fbba4de3b7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:55.173256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:55.173802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:55.174084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:55.174356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:55.175151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] RBAC: Adding query filter params (interface=public, service_id=81842e05d778408e9c120cc2ed173e48, region_id=RegionOne) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:55.175471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:55.176845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:55.190337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:55.201359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:55.201987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:55.202274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:55.202555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:55.203311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 390/782] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 19:05:54 2022] GET /identity/v3/endpoints?service_id=81842e05d778408e9c120cc2ed173e48&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:55.203448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:55.203667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:55.205066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:55.206847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:55.231356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 393/783] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:55.233814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:55.247403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:55.380024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7cc9-5d29-4c11-973d-a13e23a66065 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:55.412941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c2d21-2dfd-4932-b19f-482ed114f050 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:55.419114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:55.420080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:55.420616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:55.421095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:55.440398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:55.442096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:55.458898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:55.460349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:55.461300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:55.461300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:55.461300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:55.463553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 394/784] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:55.471922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:55.493200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45993-15dd-4560-b2a9-fecdc5c400f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:55.493818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45993-15dd-4560-b2a9-fecdc5c400f9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:55.494099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45993-15dd-4560-b2a9-fecdc5c400f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:55.494374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45993-15dd-4560-b2a9-fecdc5c400f9 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:55.494985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e45993-15dd-4560-b2a9-fecdc5c400f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:55.496364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e45993-15dd-4560-b2a9-fecdc5c400f9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:55.505743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 391/785] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:05:55 2022] GET /identity/v3/services => generated 772 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:05:55.584472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:55.663336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c72ca5-6966-4fcf-94e1-e877147d2cc7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:55.689206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fdd13-609d-4b93-a3b2-3709dafe3ef4 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:55.689401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fdd13-609d-4b93-a3b2-3709dafe3ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:55.689675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fdd13-609d-4b93-a3b2-3709dafe3ef4 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:55.691395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 392/786] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:55.696377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ccd4c-9ccd-455a-8b9c-a09d18d691fb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:55.696661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ccd4c-9ccd-455a-8b9c-a09d18d691fb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:55.696930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ccd4c-9ccd-455a-8b9c-a09d18d691fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:55.722588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e21ccd4c-9ccd-455a-8b9c-a09d18d691fb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:55.723839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e21ccd4c-9ccd-455a-8b9c-a09d18d691fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:55.729934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:55.730723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:55.730858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:55.731190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:55.731849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:55.732155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:55.735029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:55.748274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 395/787] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:55.753787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:55.810877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 393/788] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:05:55.893195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facde69-ff85-4fce-8fbe-44b5a94a690f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:55.896449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:55.947694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:55.948338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:55.948619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:55.948897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:55.956501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:55.957952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:55.972068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:55.973016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:55.973987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 396/789] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:55.979866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ccd4c-9ccd-455a-8b9c-a09d18d691fb None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:56.005979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:56.119759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ccd4c-9ccd-455a-8b9c-a09d18d691fb None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:56.154978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:56.155611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.155887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.156159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.157213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:56.157516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:56.157728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:56.158945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:56.179178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 394/790] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 19:05:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:56.185574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:56.293373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:56.295841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d83cf-130b-4296-958e-cacaba07c0a5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:56.319204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee42894-9e52-494f-899f-58ec3798f266 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:56.342792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec846756-c0a4-42ed-968c-b999ccf9cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:56.343885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846756-c0a4-42ed-968c-b999ccf9cd04 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.344308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846756-c0a4-42ed-968c-b999ccf9cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.345029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec846756-c0a4-42ed-968c-b999ccf9cd04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.356913 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908081a8-5d85-437f-89ee-723b40ddbb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:56.357667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908081a8-5d85-437f-89ee-723b40ddbb47 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.358021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908081a8-5d85-437f-89ee-723b40ddbb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.358368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908081a8-5d85-437f-89ee-723b40ddbb47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.359927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec846756-c0a4-42ed-968c-b999ccf9cd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ec846756-c0a4-42ed-968c-b999ccf9cd04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:56.366288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:56.367487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:05:56.368942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:56.371866 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 397/791] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:05:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:56.371983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908081a8-5d85-437f-89ee-723b40ddbb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:56.373347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d1ef0-9a92-43df-927b-dfc50e4beab2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.373767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d1ef0-9a92-43df-927b-dfc50e4beab2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.374176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d1ef0-9a92-43df-927b-dfc50e4beab2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.376073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 398/792] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:56.377661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d1ef0-9a92-43df-927b-dfc50e4beab2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:56.378204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908081a8-5d85-437f-89ee-723b40ddbb47 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-908081a8-5d85-437f-89ee-723b40ddbb47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:56.394681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:56.395749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:56.396678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:56.396678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:56.396678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:56.396678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 395/793] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:05:56.402482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43481b0-0080-42f2-bb50-75186d0b137c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.402482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43481b0-0080-42f2-bb50-75186d0b137c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.402482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43481b0-0080-42f2-bb50-75186d0b137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.419807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f43481b0-0080-42f2-bb50-75186d0b137c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:56.421095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:56.421206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f43481b0-0080-42f2-bb50-75186d0b137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:56.513728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d1ef0-9a92-43df-927b-dfc50e4beab2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:56.519342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 396/794] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:05:56.520532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43481b0-0080-42f2-bb50-75186d0b137c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:56.562766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:56.564795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.564795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.564795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.569769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:56.571797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:56.574707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:56.590462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 399/795] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:05:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:56.600026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:56.620633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:56.725070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43481b0-0080-42f2-bb50-75186d0b137c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:56.725264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:56.754287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f3e45-c5cb-4585-ad33-adb66a9a2e6d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:56.791754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3889a-2630-45b5-b332-9e9704d23c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:56.792374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3889a-2630-45b5-b332-9e9704d23c68 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.792653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3889a-2630-45b5-b332-9e9704d23c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.792919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3889a-2630-45b5-b332-9e9704d23c68 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.793562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3889a-2630-45b5-b332-9e9704d23c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:56.793864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3889a-2630-45b5-b332-9e9704d23c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:56.797513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3889a-2630-45b5-b332-9e9704d23c68 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:56.812871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 397/796] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:56.814109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c34f2-6536-465f-8713-aa6622cf6a2c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.814407 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c34f2-6536-465f-8713-aa6622cf6a2c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.814688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c34f2-6536-465f-8713-aa6622cf6a2c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.816162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 398/797] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:56.816869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c34f2-6536-465f-8713-aa6622cf6a2c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:56.818315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb364-faae-417e-9342-383f96a288bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:56.819171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb364-faae-417e-9342-383f96a288bb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.819621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb364-faae-417e-9342-383f96a288bb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.820061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb364-faae-417e-9342-383f96a288bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.837311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abb364-faae-417e-9342-383f96a288bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:56.838776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abb364-faae-417e-9342-383f96a288bb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-55abb364-faae-417e-9342-383f96a288bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:56.854030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:56.855027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:56.860320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:56.860320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:56.860320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:56.860320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 400/798] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:56.860320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb364-faae-417e-9342-383f96a288bb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:56.934147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c34f2-6536-465f-8713-aa6622cf6a2c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:56.954362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:56.972139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb364-faae-417e-9342-383f96a288bb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:56.972946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0099a-3c51-40f8-b79c-5f9ce0d7513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:56.973573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0099a-3c51-40f8-b79c-5f9ce0d7513b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.973926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0099a-3c51-40f8-b79c-5f9ce0d7513b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.974114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0099a-3c51-40f8-b79c-5f9ce0d7513b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:56.986931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0099a-3c51-40f8-b79c-5f9ce0d7513b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-25a0099a-3c51-40f8-b79c-5f9ce0d7513b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:05:56.992655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:56.993807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:05:56.994653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:56.995342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 399/799] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:56.996227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65d17-2a29-4e6e-bb20-34ddec6c4f27 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:56.996503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65d17-2a29-4e6e-bb20-34ddec6c4f27 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:56.996772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b65d17-2a29-4e6e-bb20-34ddec6c4f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.013984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.014617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.014897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.015241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.015436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-09b65d17-2a29-4e6e-bb20-34ddec6c4f27 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:57.016538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-09b65d17-2a29-4e6e-bb20-34ddec6c4f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:57.022192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.024245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.026213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:57.037563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:57.038457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 401/800] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:57.045132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.096499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 400/801] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:05:57.097672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b65d17-2a29-4e6e-bb20-34ddec6c4f27 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.149417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79c653-1512-4382-8737-ef08e02a09bd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.191395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.192312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.192601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.192936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.193582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:57.193892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.195398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.213478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 402/802] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:57.214374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.227765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b65d17-2a29-4e6e-bb20-34ddec6c4f27 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.259389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:57.263709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.264387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.264677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.264957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.265636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:57.265946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.267390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.278690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 401/803] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:57.279549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.283219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:57.330581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b894f-99df-4a6e-b105-2770451a17a1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.368494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.369426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.369922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.370393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.371334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:57.371861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.373488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.390755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802d98a-f034-413c-bb26-17921996a8f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.391369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 403/804] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:57.392583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.423784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.424437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.424698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.424977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.439015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.440649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:57.453471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:57.454590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 402/805] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:57.455873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.492031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:57.507514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2b86e-5274-4a4e-80cf-59b694acac69 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.526417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:57.545047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.545685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.545969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.546248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.557931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.559423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.567361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e341a-345e-49c1-aff9-d6881e9c41e8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:57.576010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:57.576952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:57.582598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:57.582598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:57.582598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:05:57.582598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 404/806] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:57.582598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.609765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.610389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.610668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.610943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] PATH_INFO: `/v3/services/network` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.611557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.612937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:57.622627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:57.623666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 19:05:57.624497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:57.628462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 403/807] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:57.629130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.690444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f534a-29ec-49b3-9cd3-61089182ecf9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.727574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec80168-8485-4e98-beb9-7739b1e7a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.728406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80168-8485-4e98-beb9-7739b1e7a8aa None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.728687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80168-8485-4e98-beb9-7739b1e7a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.729072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec80168-8485-4e98-beb9-7739b1e7a8aa None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/778fb2fe04a242a0a7e4b5b062fc0775/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.731150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec80168-8485-4e98-beb9-7739b1e7a8aa None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=778fb2fe04a242a0a7e4b5b062fc0775, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.732019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:57.733537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec80168-8485-4e98-beb9-7739b1e7a8aa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.739108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1d349-2eee-4209-aa64-61545329f6ca None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.755173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 405/808] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:05:57 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/778fb2fe04a242a0a7e4b5b062fc0775/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:57.755173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec80168-8485-4e98-beb9-7739b1e7a8aa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.791596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:57.792518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:57.793803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:57.794368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:57.795404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:57.796200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:57.796599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:57.799511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:57.823888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 404/809] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:57.825248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:57.951290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f806c-5926-4dca-9bf6-ca84e94e4c0b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:57.999324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.000427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.000906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.001616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.002905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] RBAC: Adding query filter params (name=network) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:58.003229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.004733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.009937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 405/810] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:58.010546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec80168-8485-4e98-beb9-7739b1e7a8aa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.010656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.034230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:58.053491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.054167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.054421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.055275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.056325 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:58.056638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.058261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.073062 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 406/811] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:58.074147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.144941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5c973-8669-48f1-8ad5-d781d530b01c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.186521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:58.188313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.188956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.189309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.189501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.199775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68537f-cbc9-46f6-8a7e-c60f640ff46b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.202654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.204081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:58.219800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:58.220781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:58.221655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:58.221655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:58.221655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:58.221655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 406/812] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:58.221888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.243372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acc608-c6ea-4507-b616-18bac9cbf0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.244177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc608-c6ea-4507-b616-18bac9cbf0bd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.244384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc608-c6ea-4507-b616-18bac9cbf0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.244660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc608-c6ea-4507-b616-18bac9cbf0bd None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.245420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc608-c6ea-4507-b616-18bac9cbf0bd None admin] RBAC: Adding query filter params (type=network) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:58.245724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc608-c6ea-4507-b616-18bac9cbf0bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.247113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc608-c6ea-4507-b616-18bac9cbf0bd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.252251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 407/813] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:05:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:58.253331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fff35-0f51-47d8-9e56-a7b001f18dd5 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.253732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fff35-0f51-47d8-9e56-a7b001f18dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.254010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fff35-0f51-47d8-9e56-a7b001f18dd5 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.259138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 408/814] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:05:58.259138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fff35-0f51-47d8-9e56-a7b001f18dd5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.301933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:58.341271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd06cc-f4ac-420d-8161-77e918757bab None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.367634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fff35-0f51-47d8-9e56-a7b001f18dd5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.379133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.379871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.380159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.380437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.388746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.390187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:05:58.402188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:58.403202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 407/815] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:05:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:58.404161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.408935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b181f5-e391-4e1f-a5d6-ba071cc7d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.409550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b181f5-e391-4e1f-a5d6-ba071cc7d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.409829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b181f5-e391-4e1f-a5d6-ba071cc7d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.410097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b181f5-e391-4e1f-a5d6-ba071cc7d1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.410734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b181f5-e391-4e1f-a5d6-ba071cc7d1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:58.411072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b181f5-e391-4e1f-a5d6-ba071cc7d1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.412429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b181f5-e391-4e1f-a5d6-ba071cc7d1f0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.429849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 409/816] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:58.429849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea7a9-6129-4b41-9188-7f20212ff7c3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.432319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea7a9-6129-4b41-9188-7f20212ff7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.432601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ea7a9-6129-4b41-9188-7f20212ff7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.451783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-547ea7a9-6129-4b41-9188-7f20212ff7c3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:05:58.453011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-547ea7a9-6129-4b41-9188-7f20212ff7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:05:58.463034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:58.521942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb7bda-037c-4152-a89c-bc553fb25149 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.525293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 410/817] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:05:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:05:58.526142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ea7a9-6129-4b41-9188-7f20212ff7c3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.568597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:58.580095 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be59b8-4d0b-406d-92e3-53b538d83d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.581106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be59b8-4d0b-406d-92e3-53b538d83d05 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.581656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be59b8-4d0b-406d-92e3-53b538d83d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.581938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be59b8-4d0b-406d-92e3-53b538d83d05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.582652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be59b8-4d0b-406d-92e3-53b538d83d05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.584352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be59b8-4d0b-406d-92e3-53b538d83d05 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.619140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 408/818] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:05:58 2022] POST /identity/v3/endpoints => generated 337 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:58.620206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be59b8-4d0b-406d-92e3-53b538d83d05 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.668249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ea7a9-6129-4b41-9188-7f20212ff7c3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.738365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.738926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.739235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.739511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.740283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:58.740592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.749098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.771550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:58.793560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 411/819] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:05:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:58.797872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.806619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be59b8-4d0b-406d-92e3-53b538d83d05 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.848748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.849511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.849865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.850212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:58.858730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:58.860816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:58.875826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:58.876755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 409/820] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:58.882669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:58.944675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:58.957330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869e79f-6f1b-46b4-a213-5ba245657db5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:58.994355 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff16f3-ec76-461e-bc41-9576550fb634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:58.995087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff16f3-ec76-461e-bc41-9576550fb634 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:58.995196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff16f3-ec76-461e-bc41-9576550fb634 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:58.995448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff16f3-ec76-461e-bc41-9576550fb634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.011416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57180632-e574-47ef-b8a2-b351b5445844 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.046878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.047546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.047835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.048086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.048665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.050011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:59.059512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:59.060696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:59.062037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 410/821] 10.222.0.20 () {56 vars in 1129 bytes} [Fri Sep 16 19:05:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:59.062849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:59.071806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:59.075265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff16f3-ec76-461e-bc41-9576550fb634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.077703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff16f3-ec76-461e-bc41-9576550fb634 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.166431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092735a8-85e1-4a50-9f01-f646de73f5f2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.177159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:59.192707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 412/822] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:05:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:05:59.193550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff16f3-ec76-461e-bc41-9576550fb634 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:59.214432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.215340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.215831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.216280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.217154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:59.217643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.219262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.233062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 411/823] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:59.234125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:59.303020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:59.310383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff16f3-ec76-461e-bc41-9576550fb634 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.343457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d879c1e-f708-481e-a979-bcb701eab64c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.348802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.349407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.349687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.349964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.350587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:59.350892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.352565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.361451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 413/824] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 19:05:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:59.361451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:59.385359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.385982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.386326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.386608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.397767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.400135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:05:59.416021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:05:59.416964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:05:59.417855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:05:59.417855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:05:59.417855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:05:59.417855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 412/825] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:05:59.417855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:59.447319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:59.474432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9b62e-1d61-4b2c-bb26-ca7215d85baa None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.512038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab35d0-7fba-4e89-b6f4-0db460c54526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.512694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab35d0-7fba-4e89-b6f4-0db460c54526 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.512976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab35d0-7fba-4e89-b6f4-0db460c54526 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.513254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab35d0-7fba-4e89-b6f4-0db460c54526 None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/09a4d22349684197b39b673845815054/roles/6caaeeebf7094f598c0e46561cb52144` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.529497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab35d0-7fba-4e89-b6f4-0db460c54526 None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=09a4d22349684197b39b673845815054, role_id=6caaeeebf7094f598c0e46561cb52144)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.530917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab35d0-7fba-4e89-b6f4-0db460c54526 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.532675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d53cb3-f1ae-4336-b565-5d7ce476d7f6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.549673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 414/826] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:05:59 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/09a4d22349684197b39b673845815054/roles/6caaeeebf7094f598c0e46561cb52144 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:05:59.551060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab35d0-7fba-4e89-b6f4-0db460c54526 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:59.572321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.572999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.573420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.573816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.574642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:59.575107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.576668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.582284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:59.588716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 413/827] 10.222.0.20 () {56 vars in 1124 bytes} [Fri Sep 16 19:05:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:59.590293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:59.696280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:59.715320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45278c-ba77-4e27-b9aa-15abc637513f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.724661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab35d0-7fba-4e89-b6f4-0db460c54526 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.762083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881279f9-6c54-44ef-b786-3adc648aade8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.762723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881279f9-6c54-44ef-b786-3adc648aade8 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.763027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881279f9-6c54-44ef-b786-3adc648aade8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.763306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881279f9-6c54-44ef-b786-3adc648aade8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.764108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881279f9-6c54-44ef-b786-3adc648aade8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.765800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881279f9-6c54-44ef-b786-3adc648aade8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.769438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.770052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.770433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.770597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.771448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:05:59.771576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.773582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.786114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 415/828] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:05:59.792446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:05:59.795417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 414/829] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:05:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:05:59.884613 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:05:59.922922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d62bde-bb96-47d2-ac73-84b199367d80 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:05:59.972484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87595efe-5930-42f8-8a79-7c7e46f5035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:05:59.973537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87595efe-5930-42f8-8a79-7c7e46f5035f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:05:59.974030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87595efe-5930-42f8-8a79-7c7e46f5035f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:05:59.974559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87595efe-5930-42f8-8a79-7c7e46f5035f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:05:59.984324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87595efe-5930-42f8-8a79-7c7e46f5035f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:05:59.986168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87595efe-5930-42f8-8a79-7c7e46f5035f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-87595efe-5930-42f8-8a79-7c7e46f5035f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:05:59.999243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:00.000255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:00.001158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:00.001158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:00.001158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:00.001158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:00.001158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:00.001158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:00.001158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:00.001158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:00.003585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 416/830] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:00.012137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881279f9-6c54-44ef-b786-3adc648aade8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:00.081195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4dc41-378c-411b-845e-c7b078f23f61 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:00.081858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4dc41-378c-411b-845e-c7b078f23f61 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:00.082320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4dc41-378c-411b-845e-c7b078f23f61 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:00.083955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 417/831] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:00.090146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841eb4e-6951-4546-827a-b8d9f4662a3e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:00.090425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841eb4e-6951-4546-827a-b8d9f4662a3e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:00.090697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841eb4e-6951-4546-827a-b8d9f4662a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:00.109864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a841eb4e-6951-4546-827a-b8d9f4662a3e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:00.111209 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a841eb4e-6951-4546-827a-b8d9f4662a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:00.128405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881279f9-6c54-44ef-b786-3adc648aade8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:00.169422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:00.169952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:00.170233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:00.170507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:00.171284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:00.171593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:00.173069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:00.183309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:00.187994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 415/832] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:00.198764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 418/833] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:00.198949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:00.304396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94fb63-351e-47bf-aa32-0637d372dfc6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:00.340671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:00.341578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:00.342028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:00.342469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:00.343417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=c915a2b20a2c48a682ef08528e482b96) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:00.343901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:00.345484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:00.352407 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 416/834] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:00 2022] GET /identity/v3/role_assignments?user.id=c915a2b20a2c48a682ef08528e482b96&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0f99070a6a88400199520fccd98977b6 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:00.480578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841eb4e-6951-4546-827a-b8d9f4662a3e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:00.547134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:00.591515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841eb4e-6951-4546-827a-b8d9f4662a3e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:00.629697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a57210-ac72-4084-a220-9569376c302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:00.630571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a57210-ac72-4084-a220-9569376c302b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:00.631046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a57210-ac72-4084-a220-9569376c302b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:00.631479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a57210-ac72-4084-a220-9569376c302b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:00.642849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a57210-ac72-4084-a220-9569376c302b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b8a57210-ac72-4084-a220-9569376c302b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:00.647851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:00.649436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:06:00.650453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:00.652730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 419/835] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:00.658563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:00.724317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:00.764741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2dc52-a48c-49f3-accf-a6327fa44df4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:00.799273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:00.799882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:00.800157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:00.800431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:00.801093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:00.801399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:00.802752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:00.813700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 417/836] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:00.819583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a57210-ac72-4084-a220-9569376c302b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:00.931412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a57210-ac72-4084-a220-9569376c302b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:00.950143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:00.969085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:00.969713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:00.969989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:00.970261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:00.981310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:00.982686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:00.998360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:01.000521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:01.001717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:01.001717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:01.001717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:01.001717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 420/837] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:01.005175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:01.113377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9542e91-3c65-4581-963f-623ae462b406 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:01.139405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:01.149602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:01.150208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:01.150488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:01.150760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:01.151430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:01.151729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:01.153082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:01.165136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 418/838] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:01.172275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:01.285309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c7dfc-f0d6-4964-a2e2-288e50d619b1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:01.321763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:01.322398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:01.322674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:01.322947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:01.330817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:01.332319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:01.343714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:01.344679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:01.346134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 421/839] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:06:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:01.353437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:01.458610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735088a0-2044-4f55-96fe-262641babb0a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:01.493677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df6000-7f3d-4aca-aa40-b9e8882ee4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:01.494279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df6000-7f3d-4aca-aa40-b9e8882ee4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:01.494591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df6000-7f3d-4aca-aa40-b9e8882ee4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:01.494817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df6000-7f3d-4aca-aa40-b9e8882ee4d0 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:01.495562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df6000-7f3d-4aca-aa40-b9e8882ee4d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:01.495864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df6000-7f3d-4aca-aa40-b9e8882ee4d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:01.497259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df6000-7f3d-4aca-aa40-b9e8882ee4d0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:01.514750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 419/840] 10.222.0.20 () {56 vars in 1135 bytes} [Fri Sep 16 19:06:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:01.520181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:01.558366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:01.630782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3ab3a-3438-462b-8749-8228f0144982 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:01.667889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d7eb-d69c-4521-9ae1-be6b3b581e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:01.668503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d7eb-d69c-4521-9ae1-be6b3b581e58 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:01.668781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d7eb-d69c-4521-9ae1-be6b3b581e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:01.669050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94d7eb-d69c-4521-9ae1-be6b3b581e58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:01.745270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94d7eb-d69c-4521-9ae1-be6b3b581e58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:01.746727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc94d7eb-d69c-4521-9ae1-be6b3b581e58 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:01.777414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:01.828017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960291d-b880-400c-aaef-ea5e920db351 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:01.828506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960291d-b880-400c-aaef-ea5e920db351 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:01.828506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960291d-b880-400c-aaef-ea5e920db351 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:01.830640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 420/841] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:01.836621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41720e9-f11b-49cc-a0e7-ee8c814beec7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:01.836905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41720e9-f11b-49cc-a0e7-ee8c814beec7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:01.837209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41720e9-f11b-49cc-a0e7-ee8c814beec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:01.856157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b41720e9-f11b-49cc-a0e7-ee8c814beec7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:01.857442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b41720e9-f11b-49cc-a0e7-ee8c814beec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:01.862335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 422/842] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:06:01.863243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d7eb-d69c-4521-9ae1-be6b3b581e58 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:01.923524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:01.951181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 421/843] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:01.969426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94d7eb-d69c-4521-9ae1-be6b3b581e58 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:01.999728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:02.007101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0d470-eedf-4d9c-93b3-9c5e01d9ca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.008379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d470-eedf-4d9c-93b3-9c5e01d9ca2b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.008669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d470-eedf-4d9c-93b3-9c5e01d9ca2b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.008948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d470-eedf-4d9c-93b3-9c5e01d9ca2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.019550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0d470-eedf-4d9c-93b3-9c5e01d9ca2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.021025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0d470-eedf-4d9c-93b3-9c5e01d9ca2b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-44b0d470-eedf-4d9c-93b3-9c5e01d9ca2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:02.038143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:02.039712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:02.040904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:02.040904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:02.040904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:02.040904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 423/844] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:02.045993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41720e9-f11b-49cc-a0e7-ee8c814beec7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.150810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41720e9-f11b-49cc-a0e7-ee8c814beec7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.152300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af98bca-77ba-472c-a24b-00d7f686943e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.152589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af98bca-77ba-472c-a24b-00d7f686943e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.152869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af98bca-77ba-472c-a24b-00d7f686943e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.154472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 424/845] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:02.159553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143e8e-00bf-48cb-b965-4a8990459a64 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.160103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143e8e-00bf-48cb-b965-4a8990459a64 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.160576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36143e8e-00bf-48cb-b965-4a8990459a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.179219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-36143e8e-00bf-48cb-b965-4a8990459a64 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:02.181128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-36143e8e-00bf-48cb-b965-4a8990459a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:02.189170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.189784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.190066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.190340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.190981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:02.191309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.193016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.208421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 422/846] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:02.214394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.254456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:02.260240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 425/847] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:02.260240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36143e8e-00bf-48cb-b965-4a8990459a64 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.333265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a310f37-f48b-4d70-9815-37d6c29294ce None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.375878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.377332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.377738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.378024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.386950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.388542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.390601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36143e8e-00bf-48cb-b965-4a8990459a64 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:02.403813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:02.404712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:02.405601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 423/848] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:02.408367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:02.412270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.440365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852444cf-9529-4368-a35c-7b72618a0ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.441179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852444cf-9529-4368-a35c-7b72618a0ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.441593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852444cf-9529-4368-a35c-7b72618a0ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.442029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852444cf-9529-4368-a35c-7b72618a0ca8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.453238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852444cf-9529-4368-a35c-7b72618a0ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-852444cf-9529-4368-a35c-7b72618a0ca8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:02.458262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:02.459420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:06:02.460341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:02.467692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 426/849] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:02.468757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852444cf-9529-4368-a35c-7b72618a0ca8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.518206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:02.527116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9d454-3d53-4b32-a4b0-e001c0a81dd2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.563660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.564268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.564544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.564816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.565498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:02.565801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.567260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.579424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 424/850] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:02.580113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852444cf-9529-4368-a35c-7b72618a0ca8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.580223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.628458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.629798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.630269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.630696 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.631567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:02.632034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.634430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.649371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 427/851] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:02.650815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.687192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:02.689305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e49a6b-4f44-4d73-9670-c9aff546e17a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.722728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.723371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.723650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.723923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.724508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.725845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:02.735172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:02.736169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:02.737011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 425/852] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:02.737798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.757976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:02.761488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a64e5f-afcb-4683-b9d3-e019dcad27a2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.800893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.801502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.801781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.802052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.802772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=778fb2fe04a242a0a7e4b5b062fc0775) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:02.803110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.805139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.810766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 428/853] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/role_assignments?user.id=778fb2fe04a242a0a7e4b5b062fc0775&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0f99070a6a88400199520fccd98977b6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:02.811965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.841470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e568-6870-4a52-a1ff-94ec49c372a3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.880926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ce24b-24f8-4b7f-be67-daf56a58a689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.881675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ce24b-24f8-4b7f-be67-daf56a58a689 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.881957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ce24b-24f8-4b7f-be67-daf56a58a689 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.882345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ce24b-24f8-4b7f-be67-daf56a58a689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.894866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ce24b-24f8-4b7f-be67-daf56a58a689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.896521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ce24b-24f8-4b7f-be67-daf56a58a689 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6c2ce24b-24f8-4b7f-be67-daf56a58a689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:02.913374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:02.914912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:02.916162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:02.916162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:02.916162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:02.920245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 426/854] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:02.921430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd13f-9e16-4032-b808-e016d68d1570 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.921720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd13f-9e16-4032-b808-e016d68d1570 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.922003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd13f-9e16-4032-b808-e016d68d1570 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.927530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 427/855] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:02.927530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcd13f-9e16-4032-b808-e016d68d1570 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:02.930961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:02.935671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca254e-b8fa-4fb4-b499-39a4d3fa8a52 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:02.978077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2333cac-f217-4858-8600-493335bf0691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:02.978710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333cac-f217-4858-8600-493335bf0691 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.979026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333cac-f217-4858-8600-493335bf0691 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.979303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2333cac-f217-4858-8600-493335bf0691 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:02.979952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2333cac-f217-4858-8600-493335bf0691 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:02.980257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2333cac-f217-4858-8600-493335bf0691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:02.981735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2333cac-f217-4858-8600-493335bf0691 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:02.986819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 429/856] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:02.988163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca3cd-235b-41f4-8db3-184ab168333b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:02.988447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca3cd-235b-41f4-8db3-184ab168333b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:02.988729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca3cd-235b-41f4-8db3-184ab168333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.006404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:03.008170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-657ca3cd-235b-41f4-8db3-184ab168333b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:03.009348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-657ca3cd-235b-41f4-8db3-184ab168333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:03.044215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcd13f-9e16-4032-b808-e016d68d1570 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:03.083484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 430/857] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:03.084314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca3cd-235b-41f4-8db3-184ab168333b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:03.095569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:03.097121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:03.097594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:03.098055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.099136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:03.099778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:03.101168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:03.116651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 428/858] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:03.123363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:03.188524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:03.199885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca3cd-235b-41f4-8db3-184ab168333b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:03.241242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:03.243645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:03.244143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:03.244867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.246148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:03.246660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:03.248763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:03.256065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 431/859] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:03.271628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28761b9-ed5e-463b-ada3-a0c3aae464df None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:03.306577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:03.314165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:03.314810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:03.315119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:03.315395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.324070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:03.327331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:03.344372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:03.345458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:03.346475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 429/860] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:06:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:03.354011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:03.378367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:03.483439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c065744-74a0-4c7a-85a5-0b68be1445b9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:03.490349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be7d860-471e-41c5-8933-246f900a11a0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:03.521502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:03.522585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:03.523241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:03.523813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.524847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:03.525347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:03.527201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:03.528167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:03.528863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:03.529222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:03.529546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.530308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:03.531853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:03.542767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:03.543914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:03.544821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 430/861] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 16 19:06:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:03.556520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:03.559994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 432/862] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 19:06:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:03.565553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:03.583301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:03.618507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:03.666665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13754d-e8e7-4773-ab35-3d8ec9c3cfab None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:03.685620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620fefa-8bf2-4b13-b64f-858b22a14519 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:03.704863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:03.705641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:03.706029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:03.706412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.707201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:03.707615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:03.709126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:03.718686 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 431/863] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:03.720001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:03.728398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317aaf6-bba5-4a45-831c-ebd3d2d8f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:03.729225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317aaf6-bba5-4a45-831c-ebd3d2d8f08f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:03.729670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317aaf6-bba5-4a45-831c-ebd3d2d8f08f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:03.730194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317aaf6-bba5-4a45-831c-ebd3d2d8f08f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.813651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317aaf6-bba5-4a45-831c-ebd3d2d8f08f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:03.815556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317aaf6-bba5-4a45-831c-ebd3d2d8f08f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:03.829660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd14d2-c4eb-4e29-b744-34015e2d46d0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:03.832986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:03.850034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:03.870672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:03.871691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:03.872318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:03.873186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:03.874335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:03.874847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:03.876453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:03.887483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 432/864] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:03.942575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 433/865] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 19:06:03.948523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:04.068323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62b149-cbc7-435b-9027-ec640fdcbf9b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:04.104401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:04.105040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:04.105317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:04.105588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:04.116222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:04.118217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:04.133442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:04.134438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:04.135959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:04.135959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:04.135959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:04.135959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 433/866] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:04.140129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317aaf6-bba5-4a45-831c-ebd3d2d8f08f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:04.243706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317aaf6-bba5-4a45-831c-ebd3d2d8f08f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:04.260532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:04.282266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:04.282882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:04.283270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:04.283567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:04.284243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:04.284553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:04.285983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:04.298491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 434/867] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:04.303933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:04.341510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:04.410010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd641a5-4213-4963-9bb7-d4e13a34ed6d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:04.453950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:04.454588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:04.454871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:04.455181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:04.462500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:04.463978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:04.475609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:04.477131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:04.478052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:04.478052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:04.478052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:04.478052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:04.478052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:04.478052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:04.478052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:04.478052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:04.478497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 434/868] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:04.484150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:04.591442 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1ff7c-522d-4d7a-9008-51472df25a9a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:04.628072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e56bcd-2a43-42b7-8d98-b590fe866aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:04.628705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56bcd-2a43-42b7-8d98-b590fe866aee None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:04.628992 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56bcd-2a43-42b7-8d98-b590fe866aee None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:04.629275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e56bcd-2a43-42b7-8d98-b590fe866aee None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:04.629968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e56bcd-2a43-42b7-8d98-b590fe866aee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:04.630287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e56bcd-2a43-42b7-8d98-b590fe866aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:04.631743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e56bcd-2a43-42b7-8d98-b590fe866aee None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:04.645218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 435/869] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:04.651761 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:04.752085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:04.760959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41993ebd-109d-49b6-9b58-6f57fce146be None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:04.803258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a8885-b26c-446d-b424-c92820bec7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:04.805353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a8885-b26c-446d-b424-c92820bec7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:04.806160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a8885-b26c-446d-b424-c92820bec7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:04.806942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a8885-b26c-446d-b424-c92820bec7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:04.808689 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a8885-b26c-446d-b424-c92820bec7c0 None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=09a4d22349684197b39b673845815054) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:04.809351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a8885-b26c-446d-b424-c92820bec7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:04.811430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a8885-b26c-446d-b424-c92820bec7c0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:04.821608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 435/870] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:04 2022] GET /identity/v3/role_assignments?user.id=09a4d22349684197b39b673845815054&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:05.103597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2787c8-e540-49b9-a793-ac18f657b7e3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:05.104137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2787c8-e540-49b9-a793-ac18f657b7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:05.104137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2787c8-e540-49b9-a793-ac18f657b7e3 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:05.105753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 436/871] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:05.111151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624af96d-6a9d-448a-b9e0-bd9299de4158 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:05.111568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624af96d-6a9d-448a-b9e0-bd9299de4158 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:05.111744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624af96d-6a9d-448a-b9e0-bd9299de4158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:05.130189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-624af96d-6a9d-448a-b9e0-bd9299de4158 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:05.131434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-624af96d-6a9d-448a-b9e0-bd9299de4158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:05.205604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 436/872] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:05.485032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2787c8-e540-49b9-a793-ac18f657b7e3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:05.521947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:05.597010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2787c8-e540-49b9-a793-ac18f657b7e3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:05.634156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c8d92-bf2e-4060-b66a-a805720f0b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:05.634808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d92-bf2e-4060-b66a-a805720f0b61 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:05.635120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d92-bf2e-4060-b66a-a805720f0b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:05.635455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d92-bf2e-4060-b66a-a805720f0b61 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:05.636048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c8d92-bf2e-4060-b66a-a805720f0b61 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:05.637474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c8d92-bf2e-4060-b66a-a805720f0b61 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-869c8d92-bf2e-4060-b66a-a805720f0b61 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:05.646863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:05.647909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:05.649462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 437/873] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:05.654633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624af96d-6a9d-448a-b9e0-bd9299de4158 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:05.682792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531b15-6c35-4ae0-b72d-78f3e52ddb55 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:05.683697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531b15-6c35-4ae0-b72d-78f3e52ddb55 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:05.684203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11531b15-6c35-4ae0-b72d-78f3e52ddb55 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:05.686632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 438/874] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:05.693818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eed19-eecf-4a3b-80a4-3374ac38c1e2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:05.694078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eed19-eecf-4a3b-80a4-3374ac38c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:05.694304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900eed19-eecf-4a3b-80a4-3374ac38c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:05.713222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-900eed19-eecf-4a3b-80a4-3374ac38c1e2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:05.714409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-900eed19-eecf-4a3b-80a4-3374ac38c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:05.752870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:05.762345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624af96d-6a9d-448a-b9e0-bd9299de4158 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:05.803839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 439/875] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:05.805123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f98e2d-c66d-44ca-87df-e34d5f45dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:05.805983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98e2d-c66d-44ca-87df-e34d5f45dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:05.806479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98e2d-c66d-44ca-87df-e34d5f45dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:05.806952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98e2d-c66d-44ca-87df-e34d5f45dfe0 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:05.807809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f98e2d-c66d-44ca-87df-e34d5f45dfe0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:05.808328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f98e2d-c66d-44ca-87df-e34d5f45dfe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:05.809896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f98e2d-c66d-44ca-87df-e34d5f45dfe0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:05.819305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 437/876] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:05.825632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eed19-eecf-4a3b-80a4-3374ac38c1e2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:05.859777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:05.936469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900eed19-eecf-4a3b-80a4-3374ac38c1e2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:05.977414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d83662-380c-4705-859c-fd487d8914d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:05.978328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83662-380c-4705-859c-fd487d8914d6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:05.978817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83662-380c-4705-859c-fd487d8914d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:05.979329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83662-380c-4705-859c-fd487d8914d6 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:05.980112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83662-380c-4705-859c-fd487d8914d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:05.980579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83662-380c-4705-859c-fd487d8914d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:05.982087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83662-380c-4705-859c-fd487d8914d6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:05.987587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 440/877] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:06.077127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b537b7-f145-4421-80dc-9027bdea141b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:06.077787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b537b7-f145-4421-80dc-9027bdea141b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:06.078314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b537b7-f145-4421-80dc-9027bdea141b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:06.080354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 438/878] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:06.087302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45b85-dd0b-4257-8986-77a579050ab4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:06.087916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45b85-dd0b-4257-8986-77a579050ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:06.088396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f45b85-dd0b-4257-8986-77a579050ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:06.089893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b537b7-f145-4421-80dc-9027bdea141b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:06.115532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-78f45b85-dd0b-4257-8986-77a579050ab4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:06.117619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-78f45b85-dd0b-4257-8986-77a579050ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:06.211755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b537b7-f145-4421-80dc-9027bdea141b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:06.213072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 441/879] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:06.252554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badb825-3bf6-4cc6-a245-6bab79c23aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:06.253144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb825-3bf6-4cc6-a245-6bab79c23aa9 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:06.253424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb825-3bf6-4cc6-a245-6bab79c23aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:06.253753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badb825-3bf6-4cc6-a245-6bab79c23aa9 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:06.254413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badb825-3bf6-4cc6-a245-6bab79c23aa9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:06.255812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badb825-3bf6-4cc6-a245-6bab79c23aa9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:06.275278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 439/880] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:06:06 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:06:06.484387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f45b85-dd0b-4257-8986-77a579050ab4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:06.509905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:06.594531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f45b85-dd0b-4257-8986-77a579050ab4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:06.636817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc2b10-dd6b-4197-9a70-9072d78d8618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:06.637435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2b10-dd6b-4197-9a70-9072d78d8618 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:06.637715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2b10-dd6b-4197-9a70-9072d78d8618 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:06.637993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc2b10-dd6b-4197-9a70-9072d78d8618 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:06.638647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc2b10-dd6b-4197-9a70-9072d78d8618 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:06.640058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc2b10-dd6b-4197-9a70-9072d78d8618 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:06.658007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 442/881] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:06:06 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:07.205690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a23ce-f7e3-4fb0-b14c-86f7dc851243 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:07.206032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a23ce-f7e3-4fb0-b14c-86f7dc851243 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:07.206367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a23ce-f7e3-4fb0-b14c-86f7dc851243 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:07.208062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 440/882] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:07.213735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098327-5185-4f9e-ab6a-56fddc1d6c81 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:07.214188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098327-5185-4f9e-ab6a-56fddc1d6c81 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:07.214281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94098327-5185-4f9e-ab6a-56fddc1d6c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:07.233924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-94098327-5185-4f9e-ab6a-56fddc1d6c81 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:07.235140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-94098327-5185-4f9e-ab6a-56fddc1d6c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:07.313536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 443/883] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:07.581305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a23ce-f7e3-4fb0-b14c-86f7dc851243 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:07.598349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:07.691301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a23ce-f7e3-4fb0-b14c-86f7dc851243 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:07.727748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951ae3-2c43-4d0d-a7c3-df61fcb708c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:07.728479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951ae3-2c43-4d0d-a7c3-df61fcb708c8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:07.728764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951ae3-2c43-4d0d-a7c3-df61fcb708c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:07.729043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951ae3-2c43-4d0d-a7c3-df61fcb708c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:07.739334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f951ae3-2c43-4d0d-a7c3-df61fcb708c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4f951ae3-2c43-4d0d-a7c3-df61fcb708c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:07.745098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:07.746022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:07.746860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:07.751153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 441/884] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 19:06:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:07.752520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94098327-5185-4f9e-ab6a-56fddc1d6c81 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:07.763337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:07.855729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94098327-5185-4f9e-ab6a-56fddc1d6c81 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:07.895376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:07.895998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:07.896285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:07.896560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:07.897238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:07.897542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:07.899759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:07.908896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 444/885] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 19:06:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:07.916463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951ae3-2c43-4d0d-a7c3-df61fcb708c8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:07.990079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:08.022382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951ae3-2c43-4d0d-a7c3-df61fcb708c8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:08.058709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:08.059372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.059650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.059920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.072030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:08.073553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:08.088497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:08.090634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:08.092753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:08.092753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:08.092753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:08.095031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 442/886] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:08.100072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:08.173199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:08.213852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373446b-2a86-4ae5-a52f-0d4da3b617ea None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:08.250389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b02b4d-e2f9-4f74-bca0-1d8b2c59b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:08.251019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b02b4d-e2f9-4f74-bca0-1d8b2c59b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.251306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b02b4d-e2f9-4f74-bca0-1d8b2c59b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.251581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b02b4d-e2f9-4f74-bca0-1d8b2c59b1b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.252225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b02b4d-e2f9-4f74-bca0-1d8b2c59b1b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:08.252529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b02b4d-e2f9-4f74-bca0-1d8b2c59b1b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:08.253892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b02b4d-e2f9-4f74-bca0-1d8b2c59b1b7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:08.267204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 445/887] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:08.272927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:08.317914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3192774-c4ab-484b-90fe-e8c15a9f1c69 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.318273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3192774-c4ab-484b-90fe-e8c15a9f1c69 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.318471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3192774-c4ab-484b-90fe-e8c15a9f1c69 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.320266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 446/888] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:08.325788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad919a-3dbe-417b-9cb2-84ab66bed3d9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.326071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad919a-3dbe-417b-9cb2-84ab66bed3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.326349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad919a-3dbe-417b-9cb2-84ab66bed3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.346261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-42ad919a-3dbe-417b-9cb2-84ab66bed3d9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:08.347502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-42ad919a-3dbe-417b-9cb2-84ab66bed3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:08.382506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695706d-07c5-49e6-b3f1-098d1381612f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:08.411427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:08.424125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78764898-1272-4771-b7d0-3338bbbc987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:08.425269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78764898-1272-4771-b7d0-3338bbbc987b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.425775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78764898-1272-4771-b7d0-3338bbbc987b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.426254 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78764898-1272-4771-b7d0-3338bbbc987b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.431402 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 447/889] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:08.444864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78764898-1272-4771-b7d0-3338bbbc987b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:08.446727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78764898-1272-4771-b7d0-3338bbbc987b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-78764898-1272-4771-b7d0-3338bbbc987b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:08.459783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:08.461257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:06:08.462230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:08.469192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 443/890] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:06:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:08.472058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad919a-3dbe-417b-9cb2-84ab66bed3d9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:08.521856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd0ac3-8b1a-46e7-8266-b6cdb3dfb50e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.522196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd0ac3-8b1a-46e7-8266-b6cdb3dfb50e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.522398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd0ac3-8b1a-46e7-8266-b6cdb3dfb50e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.524622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 444/891] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:08.529677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65620014-e657-417f-bf77-cc71e52e7ed3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.529966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65620014-e657-417f-bf77-cc71e52e7ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.530250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65620014-e657-417f-bf77-cc71e52e7ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.534140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:08.551125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-65620014-e657-417f-bf77-cc71e52e7ed3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:08.552333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-65620014-e657-417f-bf77-cc71e52e7ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:08.592387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad919a-3dbe-417b-9cb2-84ab66bed3d9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:08.630088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:08.630799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.631065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.631351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.632082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:08.632469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:08.634689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:08.640412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 445/892] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:08.660764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 448/893] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 19:06:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:08.662482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65620014-e657-417f-bf77-cc71e52e7ed3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:08.718555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:08.778778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65620014-e657-417f-bf77-cc71e52e7ed3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:08.799399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:08.826625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eafb1d-4409-4888-af08-e6ea675cd149 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:08.830628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe5ab6-5ff4-4f02-afa6-f2908dea19ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:08.831708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe5ab6-5ff4-4f02-afa6-f2908dea19ed None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.832224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe5ab6-5ff4-4f02-afa6-f2908dea19ed None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.832740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe5ab6-5ff4-4f02-afa6-f2908dea19ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.850145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:08.873233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76956c-e67a-4d2c-b1bc-f42c1564cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:08.873988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76956c-e67a-4d2c-b1bc-f42c1564cff4 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.874274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76956c-e67a-4d2c-b1bc-f42c1564cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.874861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76956c-e67a-4d2c-b1bc-f42c1564cff4 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.875936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76956c-e67a-4d2c-b1bc-f42c1564cff4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:08.877299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76956c-e67a-4d2c-b1bc-f42c1564cff4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:08.894945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 449/894] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:06:08 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:06:08.896177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4650c1-f61c-4a4f-9841-3bac70facef7 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.896456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4650c1-f61c-4a4f-9841-3bac70facef7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.896728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4650c1-f61c-4a4f-9841-3bac70facef7 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.898005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 450/895] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:08.904588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fe5d3-dbee-4573-9402-429aaeb6909a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:08.904868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fe5d3-dbee-4573-9402-429aaeb6909a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:08.905144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3fe5d3-dbee-4573-9402-429aaeb6909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:08.930331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe5ab6-5ff4-4f02-afa6-f2908dea19ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:08.931687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cc3fe5d3-dbee-4573-9402-429aaeb6909a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:08.932192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe5ab6-5ff4-4f02-afa6-f2908dea19ed None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:08.932929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cc3fe5d3-dbee-4573-9402-429aaeb6909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:09.024114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 451/896] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:09.025217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fe5d3-dbee-4573-9402-429aaeb6909a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.066811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 446/897] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:08 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:06:09.067990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe5ab6-5ff4-4f02-afa6-f2908dea19ed None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.085981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:09.150731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:09.154821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3fe5d3-dbee-4573-9402-429aaeb6909a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.193977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe5ab6-5ff4-4f02-afa6-f2908dea19ed None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.201045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.201772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.202126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.202471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.203564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.205053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:09.217049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:09.218492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:09.219361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 452/898] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:09.223913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.235303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.235943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.236457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.236874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.248487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.250075 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:09.270759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:09.271963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:09.273529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:09.273529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:09.273529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:09.277202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 447/899] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:09.278029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.345780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd97c1c-23e8-412c-923f-b519e272e388 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.350022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:09.382270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.382921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.383246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.383521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.384264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:09.384571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.386052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.387750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df2b5-61af-4d0a-a7ea-2ec785879f76 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.391424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 453/900] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:09.392459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.425348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.425954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.426232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.426507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.427171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:09.427473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.428832 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.434088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:09.442277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 448/901] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:09.443717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.519929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a8ac8-74d2-422d-abad-bb390e9941b2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.552155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007c06f-6356-440e-984d-8750e12f8707 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.557110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.557992 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.558446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.558893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.559681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.561300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:09.571400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:09.572348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:09.578717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 454/902] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:09.579551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.588811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:09.602391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.603277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.603751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.604029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.604661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:09.604964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.606320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.611229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 449/903] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:09.612003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.670894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:09.681302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2652456-e015-4e12-a418-ea81d28caaad None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.721224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.722207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.722637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.723125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.727762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f33be7-be22-469d-b838-c3ecaa538c84 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.732557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.734185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:09.747552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:09.748664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:09.749769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:09.749769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:09.749769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:09.749769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:09.749769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:09.749769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:09.749769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:09.749769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:09.752017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 455/904] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:09.753125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.767756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.768360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.768698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.768993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.769623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:09.769925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.771318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.781401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 450/905] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:09.781401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.838159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:09.869435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106c56d-2745-4fb2-af1f-a9edc044e12d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.888213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737d1c5-61f2-48bd-806d-9f429d372a6e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:09.907582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.908190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.908473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.908750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.909447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] RBAC: Adding query filter params (interface=public, service_id=f5302697f0654ada9628c4180f0f6862, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:09.909883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.911285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.917361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 456/906] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/endpoints?service_id=f5302697f0654ada9628c4180f0f6862&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:09.918130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:09.929026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:09.929883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:09.930220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:09.930494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:09.931216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:09.931523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:09.933028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:09.938561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:09.949459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 451/907] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:09.949459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:10.032850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad134f-d192-4c27-89c9-86fd00f77c77 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:10.052444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b913a6-bcb9-4481-8e20-13c27282a0c1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:10.068130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:10.071370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:10.071990 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:10.072274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:10.072541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:10.073171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:10.073473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:10.074834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:10.084406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 457/908] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:10.084406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:10.096352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31156b-8caa-475d-814e-21c7372934e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:10.096968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31156b-8caa-475d-814e-21c7372934e4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:10.097313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31156b-8caa-475d-814e-21c7372934e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:10.097654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31156b-8caa-475d-814e-21c7372934e4 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:10.098326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31156b-8caa-475d-814e-21c7372934e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:10.099715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31156b-8caa-475d-814e-21c7372934e4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:10.106669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 452/909] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:06:09 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:06:10.107386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31156b-8caa-475d-814e-21c7372934e4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:10.188361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:10.224734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25712eaa-a7c1-4979-a1eb-2c57eced2827 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:10.263644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31156b-8caa-475d-814e-21c7372934e4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:10.274962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:10.276273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:10.276663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:10.277507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:10.278670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] RBAC: Adding query filter params (role.id=0dc287fb7c68485487b0ee297f0b78ee, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=09a4d22349684197b39b673845815054) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:10.279184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:10.281549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:10.291691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 458/910] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:10 2022] GET /identity/v3/role_assignments?user.id=09a4d22349684197b39b673845815054&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0dc287fb7c68485487b0ee297f0b78ee => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:10.312723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5abe2-4b96-4f16-864c-7aed77522551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:10.313459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5abe2-4b96-4f16-864c-7aed77522551 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:10.313809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5abe2-4b96-4f16-864c-7aed77522551 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:10.314153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5abe2-4b96-4f16-864c-7aed77522551 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:10.314943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5abe2-4b96-4f16-864c-7aed77522551 None admin] RBAC: Adding query filter params (interface=public, service_id=de1b1438b46e44138748d7700d969b79, region_id=RegionOne) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:10.315351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5abe2-4b96-4f16-864c-7aed77522551 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:10.316831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5abe2-4b96-4f16-864c-7aed77522551 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:10.325270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 453/911] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 19:06:10 2022] GET /identity/v3/endpoints?service_id=de1b1438b46e44138748d7700d969b79&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:10.332171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:10.457689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ab3ef-0ce7-4b42-b75f-2a9e49cd21ae None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:10.495215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe35375-ffc7-4443-b1ce-a49a8df0a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:10.495833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35375-ffc7-4443-b1ce-a49a8df0a08a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:10.496116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35375-ffc7-4443-b1ce-a49a8df0a08a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:10.496394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe35375-ffc7-4443-b1ce-a49a8df0a08a None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:10.497007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe35375-ffc7-4443-b1ce-a49a8df0a08a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:10.498380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe35375-ffc7-4443-b1ce-a49a8df0a08a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:10.504729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 459/912] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:06:10 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:06:11.216746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7786-413b-4099-a054-b12982610146 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:11.217274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7786-413b-4099-a054-b12982610146 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:11.217274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e7786-413b-4099-a054-b12982610146 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:11.218891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 454/913] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:11.224404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b00d-8198-48c0-b71a-275f2ac0ae31 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:11.224692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b00d-8198-48c0-b71a-275f2ac0ae31 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:11.224974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46b00d-8198-48c0-b71a-275f2ac0ae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:11.244729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bc46b00d-8198-48c0-b71a-275f2ac0ae31 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:11.245913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bc46b00d-8198-48c0-b71a-275f2ac0ae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:11.247916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:11.323612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 460/914] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:11.596912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e7786-413b-4099-a054-b12982610146 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:11.643659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:11.704301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e7786-413b-4099-a054-b12982610146 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:11.739264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:11.739896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:11.740176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:11.741240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:11.741240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:11.742420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:11.751469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:11.752440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:11.753663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 455/915] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:11.759482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46b00d-8198-48c0-b71a-275f2ac0ae31 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:11.864182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46b00d-8198-48c0-b71a-275f2ac0ae31 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:11.901067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:11.901686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:11.901964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:11.902241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:11.902879 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:11.903215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:11.904583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:11.910144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 461/916] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:11.916027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:12.024508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eaf913-c3f3-4d09-9f70-c4fccb2f0b5d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:12.032689 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:12.062402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:12.063425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.063934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.064475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.065364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:12.065882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:12.067529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:12.073311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 456/917] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:12.080148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:12.083314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:12.187081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751fb7b-1684-42da-a5ed-cc6f3dd20fc8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:12.222945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4fa4a-d3cf-4302-9498-190f34667b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:12.223598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4fa4a-d3cf-4302-9498-190f34667b0d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.223880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4fa4a-d3cf-4302-9498-190f34667b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.224157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4fa4a-d3cf-4302-9498-190f34667b0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.224851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4fa4a-d3cf-4302-9498-190f34667b0d None admin] RBAC: Adding query filter params (interface=public, service_id=422f16c6d2aa4aa5ae0958a69be33ebc, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:12.225161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4fa4a-d3cf-4302-9498-190f34667b0d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:12.227082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4fa4a-d3cf-4302-9498-190f34667b0d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:12.232655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 462/918] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 19:06:12 2022] GET /identity/v3/endpoints?service_id=422f16c6d2aa4aa5ae0958a69be33ebc&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:12.238476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:12.348645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19cb7-0e7d-4aa6-b47a-87ef796fd659 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:12.388461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5f1fc-40b8-4816-bfc2-47e315a74fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:12.389492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5f1fc-40b8-4816-bfc2-47e315a74fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.389995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5f1fc-40b8-4816-bfc2-47e315a74fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.390474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5f1fc-40b8-4816-bfc2-47e315a74fa9 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.391339 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5f1fc-40b8-4816-bfc2-47e315a74fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:12.392994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5f1fc-40b8-4816-bfc2-47e315a74fa9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:12.401008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 457/919] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:06:12 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:06:12.497479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83885-7d66-4ffe-8b8e-fc23ca64b5b0 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.498115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83885-7d66-4ffe-8b8e-fc23ca64b5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.498618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83885-7d66-4ffe-8b8e-fc23ca64b5b0 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.500674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 463/920] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:12.506710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e015e-daaa-4a99-b637-8595c9255912 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.507874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e015e-daaa-4a99-b637-8595c9255912 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.508380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e015e-daaa-4a99-b637-8595c9255912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.528114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c86e015e-daaa-4a99-b637-8595c9255912 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:12.529718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c86e015e-daaa-4a99-b637-8595c9255912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:12.562358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:12.575698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234afc-0770-4e4b-9dea-a1b7cfd86fee None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.576050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234afc-0770-4e4b-9dea-a1b7cfd86fee None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.576252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f234afc-0770-4e4b-9dea-a1b7cfd86fee None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.578067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 464/921] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:12.584542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5829b-7d03-47df-a1bd-0008b1946c19 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.584890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5829b-7d03-47df-a1bd-0008b1946c19 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.585413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5829b-7d03-47df-a1bd-0008b1946c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.605999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-87c5829b-7d03-47df-a1bd-0008b1946c19 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:12.607257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-87c5829b-7d03-47df-a1bd-0008b1946c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:12.609710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 458/922] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:12.681522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:12.687997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 465/923] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:12.741260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b4b3-1ce7-4b37-bf6c-8b9b1ddc24ae None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.742183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b4b3-1ce7-4b37-bf6c-8b9b1ddc24ae None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.742607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5b4b3-1ce7-4b37-bf6c-8b9b1ddc24ae None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.744496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 459/924] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:12.749804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282d79-6b2b-490f-a737-f44a2784f521 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:12.750289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282d79-6b2b-490f-a737-f44a2784f521 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:12.750722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282d79-6b2b-490f-a737-f44a2784f521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:12.769016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b0282d79-6b2b-490f-a737-f44a2784f521 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:12.770437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b0282d79-6b2b-490f-a737-f44a2784f521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:12.841433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 466/925] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:12.892043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5b4b3-1ce7-4b37-bf6c-8b9b1ddc24ae None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:12.975268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282d79-6b2b-490f-a737-f44a2784f521 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.008158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5b4b3-1ce7-4b37-bf6c-8b9b1ddc24ae None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.050595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.051420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.051808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.052127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.052725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.054561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:13.065540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:13.066806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:13.072946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 460/926] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:13.075559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.098202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282d79-6b2b-490f-a737-f44a2784f521 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.107729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:13.127104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:13.137641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a78cf-0613-4314-ab1b-ba61bd8a6eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.138281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a78cf-0613-4314-ab1b-ba61bd8a6eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.138563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a78cf-0613-4314-ab1b-ba61bd8a6eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.138837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a78cf-0613-4314-ab1b-ba61bd8a6eb3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.150586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a78cf-0613-4314-ab1b-ba61bd8a6eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-911a78cf-0613-4314-ab1b-ba61bd8a6eb3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:13.155387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:13.156313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:13.157166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 467/927] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 19:06:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:13.157888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a78cf-0613-4314-ab1b-ba61bd8a6eb3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.189896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec0669-4bf3-4378-a5a7-bd03d85bf15c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.225495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.226528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.226814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.227157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.227788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:13.228088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.229434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.234192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 461/928] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:13.234967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.270004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a78cf-0613-4314-ab1b-ba61bd8a6eb3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.307217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.307852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.308134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.308409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.308994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.310359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:13.319955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:13.326292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:13.327266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 468/929] 10.222.0.20 () {56 vars in 1132 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:13.328077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.332621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:13.344156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435486f9-d3fd-44fa-ba7f-2bd9e6aa7849 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.377969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:13.380233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.380864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.381283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.381561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.382743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:13.383088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.384472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.394518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 462/930] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:13.395502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.448939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf620e-a119-4078-a173-8b9d735c582d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.485381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.485989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.486272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.486550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.487673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:13.488010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.489370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.495049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 469/931] 10.222.0.20 () {56 vars in 1114 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:13.495828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.522617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a97a92-035e-4652-a87d-0737b6836586 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.563112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.563665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.564003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.564226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.565241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:13.565241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.566585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.575936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 463/932] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:13.575936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.596306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:13.605757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480958ee-2b7f-4607-810d-e1ad8685112a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.622947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:13.644228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.644859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.645137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.645409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.656647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.658087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:13.673173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:13.674116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:13.674979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:13.674979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:13.674979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:13.674979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 470/933] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:13.675260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.685771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f1c730-40af-411e-89ad-a5a32fc13c1f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.721087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3eb8-8957-4f0b-981b-30bcbe24a439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.721698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3eb8-8957-4f0b-981b-30bcbe24a439 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.721973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3eb8-8957-4f0b-981b-30bcbe24a439 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.723854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3eb8-8957-4f0b-981b-30bcbe24a439 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.723854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3eb8-8957-4f0b-981b-30bcbe24a439 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.724272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3eb8-8957-4f0b-981b-30bcbe24a439 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.746019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 464/934] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:06:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:13.747234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3eb8-8957-4f0b-981b-30bcbe24a439 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.805986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680025c8-e83b-4c56-8dfc-b18a3ed06bca None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.858289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.858911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.859282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.859564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.860266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:13.860575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.861965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.863874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:13.872066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 471/935] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:13.878829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.901335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3eb8-8957-4f0b-981b-30bcbe24a439 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:13.911478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:13.941468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:13.942244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:13.942635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:13.943023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:13.943964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:13.944373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:13.947219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:13.960952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 465/936] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:13.967552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:13.999550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc78665-6fed-418d-a007-d67b9de571eb None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:14.050284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668643cc-0c7a-4236-bbe7-4876efaafcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:14.050903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668643cc-0c7a-4236-bbe7-4876efaafcec None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:14.051226 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668643cc-0c7a-4236-bbe7-4876efaafcec None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:14.051504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668643cc-0c7a-4236-bbe7-4876efaafcec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:14.052177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668643cc-0c7a-4236-bbe7-4876efaafcec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:14.054317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668643cc-0c7a-4236-bbe7-4876efaafcec None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:14.082898 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba723919-2a0f-4a80-ac39-d34290264944 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:14.087697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 472/937] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:06:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:14.130163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:14.137627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:14.138373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:14.138660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:14.138929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:14.148031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:14.149643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:14.164058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:14.165421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:06:14.166346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:14.170394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 466/938] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:06:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:14.171859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668643cc-0c7a-4236-bbe7-4876efaafcec None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:14.271473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:14.294971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668643cc-0c7a-4236-bbe7-4876efaafcec None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:14.333499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:14.334039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:14.334320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:14.334596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:14.335681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:14.336053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:14.337547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:14.356527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 473/939] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 19:06:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:14.361971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:14.470404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263b906-a317-41d1-b035-6270e1152269 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:14.506557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:14.507299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:14.507571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:14.507846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:14.518928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:14.520400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:14.536064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:14.537023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:14.537897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:14.537897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:14.537897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:14.541992 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 467/940] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:14.544117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:14.654589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c88b54-cb63-42ea-b331-448745fdd03d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:14.689643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df208b2-91cc-44e4-ab73-f79ed0ba24f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:14.690359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df208b2-91cc-44e4-ab73-f79ed0ba24f1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:14.690646 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df208b2-91cc-44e4-ab73-f79ed0ba24f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:14.690921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df208b2-91cc-44e4-ab73-f79ed0ba24f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:14.691639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df208b2-91cc-44e4-ab73-f79ed0ba24f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:14.691947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df208b2-91cc-44e4-ab73-f79ed0ba24f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:14.693360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df208b2-91cc-44e4-ab73-f79ed0ba24f1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:14.702885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:14.709973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 474/941] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:14.712428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:14.735418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62771-4091-4c31-bad3-b365b3c23715 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:14.735724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62771-4091-4c31-bad3-b365b3c23715 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:14.735986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62771-4091-4c31-bad3-b365b3c23715 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:14.737599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 475/942] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:14.743041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba94192-c2f7-4ce8-87b6-a2ec2f0d2c8f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:14.743328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba94192-c2f7-4ce8-87b6-a2ec2f0d2c8f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:14.743603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba94192-c2f7-4ce8-87b6-a2ec2f0d2c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:14.766019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6ba94192-c2f7-4ce8-87b6-a2ec2f0d2c8f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:14.767665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6ba94192-c2f7-4ce8-87b6-a2ec2f0d2c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:14.773303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:14.844299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 476/943] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:14.852880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeed14-ad9e-4e4c-a01b-1a343480e178 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:14.887117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:14.888076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:14.888552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:14.889041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:14.896123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:14.897987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:14.909852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:14.910740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:14.911640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:14.911640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:14.911640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:14.911640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:14.911640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:14.911640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:14.911640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:14.911640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:14.914574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 468/944] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:14.921328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba94192-c2f7-4ce8-87b6-a2ec2f0d2c8f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:15.025767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba94192-c2f7-4ce8-87b6-a2ec2f0d2c8f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:15.061592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:15.062569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:15.063084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:15.063654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:15.064636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:15.065155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:15.066847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:15.069193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:15.087159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 477/945] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:15.089403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:15.144488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:15.195749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98997c4e-1feb-4a13-8cb4-ce21356d0b7e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:15.197475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:15.232997 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e19b0-0c13-4ca3-89f5-d468fcd1e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:15.233652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e19b0-0c13-4ca3-89f5-d468fcd1e967 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:15.233929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e19b0-0c13-4ca3-89f5-d468fcd1e967 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:15.234202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e19b0-0c13-4ca3-89f5-d468fcd1e967 None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/09a4d22349684197b39b673845815054/roles/0dc287fb7c68485487b0ee297f0b78ee` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:15.236469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e19b0-0c13-4ca3-89f5-d468fcd1e967 None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=09a4d22349684197b39b673845815054, role_id=0dc287fb7c68485487b0ee297f0b78ee)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:15.237893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e19b0-0c13-4ca3-89f5-d468fcd1e967 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:15.259026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 469/946] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:06:15 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/09a4d22349684197b39b673845815054/roles/0dc287fb7c68485487b0ee297f0b78ee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:06:15.263686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7e2b6-a763-4d17-aef5-768f013f6801 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:15.304425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:15.305141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:15.305401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:15.305629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:15.306212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:15.307671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:15.317656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:15.318736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:15.320123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 478/947] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:15.325342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e19b0-0c13-4ca3-89f5-d468fcd1e967 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:15.436906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e19b0-0c13-4ca3-89f5-d468fcd1e967 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:15.475090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:15.475584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:15.476692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:15.476971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:15.477603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:15.477904 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:15.479355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:15.484473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 470/948] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:15.490122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:15.550474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:15.597422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4d22c-bac5-4a51-98ac-665c073be9d2 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:15.633503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f193316f-8f5f-4df1-a2c8-c1462da921d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:15.634114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193316f-8f5f-4df1-a2c8-c1462da921d2 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:15.634397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193316f-8f5f-4df1-a2c8-c1462da921d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:15.634671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193316f-8f5f-4df1-a2c8-c1462da921d2 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:15.635335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193316f-8f5f-4df1-a2c8-c1462da921d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:15.635638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193316f-8f5f-4df1-a2c8-c1462da921d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:15.637008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f193316f-8f5f-4df1-a2c8-c1462da921d2 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:15.642384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 479/949] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:15.648107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:15.676698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:15.752697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8308bde-8585-4849-aca0-80b5c61550af None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:15.788500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939e724-64fd-4f77-b7da-fb240c05c353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:15.789154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e724-64fd-4f77-b7da-fb240c05c353 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:15.789440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e724-64fd-4f77-b7da-fb240c05c353 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:15.789714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939e724-64fd-4f77-b7da-fb240c05c353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:15.790380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939e724-64fd-4f77-b7da-fb240c05c353 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:15.791764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939e724-64fd-4f77-b7da-fb240c05c353 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:15.820747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 471/950] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:06:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:16.099550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2b52-762e-4e99-8be4-787ac1e3b52d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:16.099893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2b52-762e-4e99-8be4-787ac1e3b52d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:16.100013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2b52-762e-4e99-8be4-787ac1e3b52d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:16.102163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 480/951] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:16.107653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd32c-e6e3-4d1d-8d6e-71819e47dbf7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:16.107932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd32c-e6e3-4d1d-8d6e-71819e47dbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:16.108213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cd32c-e6e3-4d1d-8d6e-71819e47dbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:16.126731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d04cd32c-e6e3-4d1d-8d6e-71819e47dbf7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:16.127991 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d04cd32c-e6e3-4d1d-8d6e-71819e47dbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:16.202228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 472/952] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:16.415202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1a5b-03d5-4fca-a2ba-1df5379386ca None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:16.415699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1a5b-03d5-4fca-a2ba-1df5379386ca None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:16.415699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb1a5b-03d5-4fca-a2ba-1df5379386ca None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:16.417232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 481/953] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:16.422389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11a2b-9d45-423b-9760-a1d9e7a610ff None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:16.422680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11a2b-9d45-423b-9760-a1d9e7a610ff None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:16.422963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad11a2b-9d45-423b-9760-a1d9e7a610ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:16.441882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6ad11a2b-9d45-423b-9760-a1d9e7a610ff None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:16.443174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6ad11a2b-9d45-423b-9760-a1d9e7a610ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:16.445981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:16.475253 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb1a5b-03d5-4fca-a2ba-1df5379386ca None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:16.520554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 473/954] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:16.586765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb1a5b-03d5-4fca-a2ba-1df5379386ca None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:16.604928 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:16.623805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:16.624417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:16.624697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:16.624971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:16.625625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:16.627091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:16.629684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING keystone.server.flask.common [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 16 19:06:16.649495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.sql.core [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 19:06:16.649495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 19:06:16.649495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [parameters: {'id': 'ca35ef167f34401388759bf474c7ee9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 19:06:16.649495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81368) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca35ef167f34401388759bf474c7ee9f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca35ef167f34401388759bf474c7ee9f. Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:06:16.666655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result.read() Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 16 19:06:16.667547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application yield resource Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise self.value Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application session.commit() Sep 16 19:06:16.668501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.session.flush() Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application compat.raise_( Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 19:06:16.669391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 19:06:16.670299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result.read() Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:06:16.672118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [parameters: {'id': 'ca35ef167f34401388759bf474c7ee9f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:16.674115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:16.675967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ca35ef167f34401388759bf474c7ee9f. Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.683327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 482/955] 10.222.0.20 () {60 vars in 1140 bytes} [Fri Sep 16 19:06:16 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:16.684612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11a2b-9d45-423b-9760-a1d9e7a610ff None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:16.787331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad11a2b-9d45-423b-9760-a1d9e7a610ff None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:16.802860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:16.824318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:16.824821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:16.825100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:16.825372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:16.832959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:16.834488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:16.846962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:16.849446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:16.851697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 474/956] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:16.855604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:16.914932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976c5be-3047-4e63-a2c7-b722f541b0ed None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:16.956509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:16.957440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:16.957959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:16.958528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:16.959341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:16.961924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:16.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:16.972272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:16.973349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:16.980987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 483/957] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:16.982091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:16.999209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500a2ca3-105e-465a-be20-3d2a7cb30267 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:17.035665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:17.036005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:17.036774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:17.037410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:17.037410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:17.038531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:17.039148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:17.040744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:17.059682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 475/958] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:06:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:17.118654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afc6d9-b2b9-4f11-9f32-cbfe16d223ed None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:17.159557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d02989-f318-423b-8832-37c809871128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:17.160189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02989-f318-423b-8832-37c809871128 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:17.160470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02989-f318-423b-8832-37c809871128 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:17.160747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d02989-f318-423b-8832-37c809871128 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:17.161403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d02989-f318-423b-8832-37c809871128 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:17.161711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d02989-f318-423b-8832-37c809871128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:17.163762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d02989-f318-423b-8832-37c809871128 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:17.172844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 484/959] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:06:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:17.178652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:17.246453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:17.290190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b61fbb-7bda-4c91-9415-700da3cfd7f4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:17.327118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1fddf-9872-4084-8cfb-7bff7b63d40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:17.327739 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1fddf-9872-4084-8cfb-7bff7b63d40b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:17.328023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1fddf-9872-4084-8cfb-7bff7b63d40b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:17.328303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1fddf-9872-4084-8cfb-7bff7b63d40b None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:17.328944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1fddf-9872-4084-8cfb-7bff7b63d40b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:17.329252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1fddf-9872-4084-8cfb-7bff7b63d40b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:17.330627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1fddf-9872-4084-8cfb-7bff7b63d40b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:17.336286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 476/960] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:06:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:17.731018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33084d3-c991-4c19-ac72-5b173d23a121 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:17.731674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33084d3-c991-4c19-ac72-5b173d23a121 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:17.731674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33084d3-c991-4c19-ac72-5b173d23a121 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:17.733158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 485/961] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:17.738195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad48cd-fca8-421a-89fb-628773656122 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:17.738669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad48cd-fca8-421a-89fb-628773656122 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:17.738821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad48cd-fca8-421a-89fb-628773656122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:17.758592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-65ad48cd-fca8-421a-89fb-628773656122 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:17.759830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-65ad48cd-fca8-421a-89fb-628773656122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:17.832492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 477/962] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:18.111864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33084d3-c991-4c19-ac72-5b173d23a121 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:18.198871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83594f6-8736-48e4-8cac-b0fb1e53e2dc None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:18.199566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83594f6-8736-48e4-8cac-b0fb1e53e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:18.200046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83594f6-8736-48e4-8cac-b0fb1e53e2dc None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:18.201791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 478/963] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:18.207130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609ede-964d-4e08-b4d6-5b5c5217203b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:18.207642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609ede-964d-4e08-b4d6-5b5c5217203b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:18.208113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17609ede-964d-4e08-b4d6-5b5c5217203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:18.220973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33084d3-c991-4c19-ac72-5b173d23a121 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:18.223259 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:18.228028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-17609ede-964d-4e08-b4d6-5b5c5217203b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:18.229446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-17609ede-964d-4e08-b4d6-5b5c5217203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:18.271775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e850b-6314-4970-a756-048760a21cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:18.272953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e850b-6314-4970-a756-048760a21cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:18.273295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e850b-6314-4970-a756-048760a21cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:18.273539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e850b-6314-4970-a756-048760a21cd7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:18.282245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:18.287308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e850b-6314-4970-a756-048760a21cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-5a1e850b-6314-4970-a756-048760a21cd7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:18.293987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:18.294893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:18.295815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 486/964] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 19:06:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:18.301554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e850b-6314-4970-a756-048760a21cd7 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:18.316567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 479/965] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:18.412609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e850b-6314-4970-a756-048760a21cd7 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:18.455616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:18.456533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:18.457016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:18.457519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:18.458380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:18.458926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:18.461078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:18.470282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 487/966] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 19:06:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:18.475775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609ede-964d-4e08-b4d6-5b5c5217203b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:18.581477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17609ede-964d-4e08-b4d6-5b5c5217203b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:18.611731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:18.619118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:18.619760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:18.620044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:18.620324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:18.630897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:18.632991 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:18.640205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:18.648601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:18.649711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:18.650675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:18.650675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:18.650675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:18.650675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 480/967] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:18.655474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:18.715410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:18.744313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aaa9d-0975-487f-81a4-631ca577f972 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:18.784183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29913-7cb3-40bd-9e8a-1211f683f632 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:18.785495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:18.786360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:18.786849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:18.787364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:18.788181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:18.789772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:18.799193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:18.800237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:18.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:18.804392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 488/968] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:18.815038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:18.825409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:18.826614 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:18.827364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:18.827803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:18.828705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:18.829203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:18.830803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:18.846413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 481/969] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:18.852949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:18.924963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:18.944457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c75875-12de-4467-a5a7-3a4f0236a989 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:18.955358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:18.964991 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38c17b-6db4-47a1-972e-024bcc34e8d4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:18.996239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:18.996819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:18.997204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:18.997486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:18.998223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:18.998528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:18.999937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.005352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 489/970] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:19.007866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:19.008578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.008936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.009288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.010949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:19.017487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:19.019047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:19.031628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:19.032586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 19:06:19.033577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:19.037718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 482/971] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:06:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:19.039298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:19.126830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91b544-9153-4b97-b3e4-fa59a7bfab34 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:19.148198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c82c7-d54b-4299-86aa-11e35bfb7b50 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:19.165929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:19.166956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.167497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.167993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.168890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:19.169447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:19.171040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.177118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 490/972] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:19.183088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:19.186657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:19.187366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.187647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.187925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.188666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:19.188978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:19.190407 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.210974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:19.214011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 483/973] 10.222.0.20 () {56 vars in 1149 bytes} [Fri Sep 16 19:06:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:19.216950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:19.234727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:19.338516 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cfd5f-5c86-4009-8bec-217bc0b783e5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:19.343922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fe5dc-c777-458b-8d2e-3755d31514b6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:19.381310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2b884-684d-47e6-9c41-2111ae896091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:19.381643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d9b8a-1d34-40a7-9149-f36f0a21e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:19.381950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b884-684d-47e6-9c41-2111ae896091 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.382186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d9b8a-1d34-40a7-9149-f36f0a21e4fc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.382284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b884-684d-47e6-9c41-2111ae896091 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.382497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b884-684d-47e6-9c41-2111ae896091 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.382591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d9b8a-1d34-40a7-9149-f36f0a21e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.382821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d9b8a-1d34-40a7-9149-f36f0a21e4fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.383243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b884-684d-47e6-9c41-2111ae896091 None admin] RBAC: Adding query filter params (interface=admin, service_id=422f16c6d2aa4aa5ae0958a69be33ebc, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:19.383557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b884-684d-47e6-9c41-2111ae896091 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:19.384919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b884-684d-47e6-9c41-2111ae896091 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.390301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 491/974] 10.222.0.20 () {56 vars in 1249 bytes} [Fri Sep 16 19:06:19 2022] GET /identity/v3/endpoints?service_id=422f16c6d2aa4aa5ae0958a69be33ebc&interface=admin®ion_id=RegionOne => generated 193 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:19.391270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7fa2-2f83-442e-99fe-e313281e7754 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.391554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7fa2-2f83-442e-99fe-e313281e7754 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.391831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd7fa2-2f83-442e-99fe-e313281e7754 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.393172 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 492/975] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:19.396186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7fa2-2f83-442e-99fe-e313281e7754 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:19.466533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d9b8a-1d34-40a7-9149-f36f0a21e4fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:19.468015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d9b8a-1d34-40a7-9149-f36f0a21e4fc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.483634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:19.490739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:19.515113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd7fa2-2f83-442e-99fe-e313281e7754 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:19.554295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18775e48-f04f-42fe-8313-b66ef8108282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:19.555614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775e48-f04f-42fe-8313-b66ef8108282 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.556187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775e48-f04f-42fe-8313-b66ef8108282 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.556720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18775e48-f04f-42fe-8313-b66ef8108282 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.557537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18775e48-f04f-42fe-8313-b66ef8108282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:19.559269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18775e48-f04f-42fe-8313-b66ef8108282 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.566791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 493/976] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:06:19 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:06:19.568323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25e61-0849-4849-b8cc-f72158e23c8e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.568959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25e61-0849-4849-b8cc-f72158e23c8e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.569440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25e61-0849-4849-b8cc-f72158e23c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.592759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 484/977] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:06:19.595828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f3c25e61-0849-4849-b8cc-f72158e23c8e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:19.597709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f3c25e61-0849-4849-b8cc-f72158e23c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:19.598049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d9b8a-1d34-40a7-9149-f36f0a21e4fc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:19.681311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 494/978] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:19.682981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db81c8-cba9-4a00-a002-bd051220dba5 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.683518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db81c8-cba9-4a00-a002-bd051220dba5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.683989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db81c8-cba9-4a00-a002-bd051220dba5 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.685511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 495/979] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:19.691181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24d30-f097-4f44-b0ce-236e8a04bba3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.691765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24d30-f097-4f44-b0ce-236e8a04bba3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.692265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24d30-f097-4f44-b0ce-236e8a04bba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.719765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-39f24d30-f097-4f44-b0ce-236e8a04bba3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:19.722070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-39f24d30-f097-4f44-b0ce-236e8a04bba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:19.723395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d9b8a-1d34-40a7-9149-f36f0a21e4fc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:19.739474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:19.768509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:19.770440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.770943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.771454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.782639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:19.784937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:19.804640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:19.805624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:19.806652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:19.806652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:19.806652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:19.806652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 485/980] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:19.811968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:19.817858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 496/981] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:19.923055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2be8c-5299-4782-a7d5-cd3298c79d26 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:19.958400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:19.959021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:19.959318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:19.959598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:19.960329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:19.960637 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:19.962012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:19.970023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24d30-f097-4f44-b0ce-236e8a04bba3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:19.974167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:19.976104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 486/982] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:19.981930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:20.009199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:20.083040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24d30-f097-4f44-b0ce-236e8a04bba3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:20.088548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959a121-94a5-46a4-a70e-853b092ad9dd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:20.124604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:20.125651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:20.126129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:20.126661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:20.134235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:20.134856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:20.135173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:20.135451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:20.135693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:20.136111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:20.137546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:20.137827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:20.149785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:20.151030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:20.152168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:20.152168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:20.152168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:20.152168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:20.152168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:20.152168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:20.152168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:20.152168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:20.152789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 487/983] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:20.153260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:20.159037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.sql.core [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 19:06:20.159037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 19:06:20.159037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [parameters: {'user_id': '3b3fe743aa104d4aa0da4e0015bb9fc8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 19:06:20.159037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81368) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result.read() Sep 16 19:06:20.166914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:06:20.168011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application yield resource Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application next(self.gen) Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise self.value Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application session.commit() Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 19:06:20.169213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.session.flush() Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application compat.raise_( Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 19:06:20.170373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 19:06:20.171483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application conn.query(q) Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application result.read() Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 19:06:20.172531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [parameters: {'user_id': '3b3fe743aa104d4aa0da4e0015bb9fc8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:20.173612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 16 19:06:20.174593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 16 19:06:20.176173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 16 19:06:20.176173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 16 19:06:20.176173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 19:06:20.176173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 19:06:20.176173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 19:06:20.176173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:20.176173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 497/984] 10.222.0.20 () {60 vars in 1131 bytes} [Fri Sep 16 19:06:19 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:20.176173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:20.249849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:20.253544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:20.271825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b076f-9c50-42ca-a2fd-2258be9f2274 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:20.290005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514f276-4744-4d37-adf4-c0ef2a966d4f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:20.309351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dddd5-bbc2-4945-9351-3f3957fcced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:20.309976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dddd5-bbc2-4945-9351-3f3957fcced3 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:20.310260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dddd5-bbc2-4945-9351-3f3957fcced3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:20.310541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36dddd5-bbc2-4945-9351-3f3957fcced3 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:20.311311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36dddd5-bbc2-4945-9351-3f3957fcced3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:20.312856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36dddd5-bbc2-4945-9351-3f3957fcced3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:20.328377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:20.328999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:20.329284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:20.329564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:20.330266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:20.330578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:20.332297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:20.339375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 488/985] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:06:20 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:20.343746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dddd5-bbc2-4945-9351-3f3957fcced3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:20.358326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 498/986] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:20.359955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:20.488074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36dddd5-bbc2-4945-9351-3f3957fcced3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:20.495747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84f131-52dc-4b25-9168-e5cb695b8544 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:20.527419 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:20.539385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb00d40-c1df-48d3-bd71-fcb65fef5ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:20.540026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00d40-c1df-48d3-bd71-fcb65fef5ffe None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:20.540305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00d40-c1df-48d3-bd71-fcb65fef5ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:20.540409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:20.540599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00d40-c1df-48d3-bd71-fcb65fef5ffe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:20.540934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:20.541216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:20.541491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:20.542255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] RBAC: Adding query filter params (role.id=0dc287fb7c68485487b0ee297f0b78ee, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=09a4d22349684197b39b673845815054) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:20.542567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:20.544035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:20.549413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb00d40-c1df-48d3-bd71-fcb65fef5ffe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:20.550217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 499/987] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:20 2022] GET /identity/v3/role_assignments?user.id=09a4d22349684197b39b673845815054&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0dc287fb7c68485487b0ee297f0b78ee => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:20.550919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb00d40-c1df-48d3-bd71-fcb65fef5ffe None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:20.555629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0cb00d40-c1df-48d3-bd71-fcb65fef5ffe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:20.565764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:20.566838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:20.567849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 489/988] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:06:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:20.573989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:20.690222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd0120-50e7-4124-83eb-4a250bc755bd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:20.729918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757337ce-e392-41a2-8fb9-89adc4b9ba75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:20.730844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757337ce-e392-41a2-8fb9-89adc4b9ba75 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:20.731322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757337ce-e392-41a2-8fb9-89adc4b9ba75 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:20.731747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757337ce-e392-41a2-8fb9-89adc4b9ba75 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:20.732594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757337ce-e392-41a2-8fb9-89adc4b9ba75 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:20.733060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757337ce-e392-41a2-8fb9-89adc4b9ba75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:20.734687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757337ce-e392-41a2-8fb9-89adc4b9ba75 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:20.772685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 500/989] 10.222.0.20 () {56 vars in 1101 bytes} [Fri Sep 16 19:06:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:21.822744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9c3b-5d53-41c0-8bbb-f9b44349a338 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:21.823297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9c3b-5d53-41c0-8bbb-f9b44349a338 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:21.823377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af9c3b-5d53-41c0-8bbb-f9b44349a338 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:21.824817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 490/990] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:21.829937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6b91-59fa-4e39-9a9c-adf1a2c544dd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:21.830315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6b91-59fa-4e39-9a9c-adf1a2c544dd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:21.830526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d6b91-59fa-4e39-9a9c-adf1a2c544dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:21.850487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-783d6b91-59fa-4e39-9a9c-adf1a2c544dd None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:21.852371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-783d6b91-59fa-4e39-9a9c-adf1a2c544dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:21.897365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:21.922102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 501/991] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:22.191904 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9c3b-5d53-41c0-8bbb-f9b44349a338 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:22.295783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af9c3b-5d53-41c0-8bbb-f9b44349a338 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:22.329771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:22.330407 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:22.330687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:22.330963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:22.331581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:22.332948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:22.341774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:22.342746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 19:06:22.344049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:22.347314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 491/992] 10.222.0.20 () {56 vars in 1126 bytes} [Fri Sep 16 19:06:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:22.348722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d6b91-59fa-4e39-9a9c-adf1a2c544dd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:22.455386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d6b91-59fa-4e39-9a9c-adf1a2c544dd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:22.495167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bb7f2-d4a5-4c24-86bd-83a88cfbea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:22.495805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bb7f2-d4a5-4c24-86bd-83a88cfbea7b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:22.496086 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bb7f2-d4a5-4c24-86bd-83a88cfbea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:22.496360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bb7f2-d4a5-4c24-86bd-83a88cfbea7b None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:22.497011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bb7f2-d4a5-4c24-86bd-83a88cfbea7b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:22.497318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bb7f2-d4a5-4c24-86bd-83a88cfbea7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:22.498826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bb7f2-d4a5-4c24-86bd-83a88cfbea7b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:22.509459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 502/993] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:22.510528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:22.574768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:22.588068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad593-d21b-488c-93ec-019fa68aee31 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:22.588378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad593-d21b-488c-93ec-019fa68aee31 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:22.588628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ad593-d21b-488c-93ec-019fa68aee31 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:22.590737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 503/994] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:22.595495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073283a-7d53-4d3f-b1a7-739289ae04bb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:22.595783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073283a-7d53-4d3f-b1a7-739289ae04bb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:22.596064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073283a-7d53-4d3f-b1a7-739289ae04bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:22.614694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7073283a-7d53-4d3f-b1a7-739289ae04bb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:22.616428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7073283a-7d53-4d3f-b1a7-739289ae04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:22.619373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c45522-10fa-4d2a-863c-af4c9151e3e3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:22.655918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:22.657138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:22.657733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:22.658020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:22.658342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:22.659171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:22.659485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:22.660851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:22.673793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 492/995] 10.222.0.20 () {56 vars in 1122 bytes} [Fri Sep 16 19:06:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:22.674912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:22.696484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 504/996] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:22.771733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a6ece-46e4-4ff6-9de3-23e3438dd52d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:22.771973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a6ece-46e4-4ff6-9de3-23e3438dd52d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:22.772340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a6ece-46e4-4ff6-9de3-23e3438dd52d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:22.773699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 505/997] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:22.778657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25bdd6-c4ff-4222-a6f6-20d79cf22257 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:22.779163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25bdd6-c4ff-4222-a6f6-20d79cf22257 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:22.779273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25bdd6-c4ff-4222-a6f6-20d79cf22257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:22.781814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108926ac-fbbf-4e81-9a14-f9285c1f7237 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:22.797101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1e25bdd6-c4ff-4222-a6f6-20d79cf22257 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:22.798253 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1e25bdd6-c4ff-4222-a6f6-20d79cf22257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:22.809492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:22.818662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4240e-65ef-40e2-aeed-30b65bb58511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:22.819854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4240e-65ef-40e2-aeed-30b65bb58511 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:22.820125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4240e-65ef-40e2-aeed-30b65bb58511 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:22.820395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4240e-65ef-40e2-aeed-30b65bb58511 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:22.821055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4240e-65ef-40e2-aeed-30b65bb58511 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:22.822410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4240e-65ef-40e2-aeed-30b65bb58511 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:22.840729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 493/998] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:06:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:06:22.886204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 506/999] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:22.966238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4240e-65ef-40e2-aeed-30b65bb58511 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:23.076874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4240e-65ef-40e2-aeed-30b65bb58511 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:23.112362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:23.113003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:23.113284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:23.113562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:23.114148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:23.115626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:23.124495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:23.125488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:23.126708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 494/1000] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:23.132232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25bdd6-c4ff-4222-a6f6-20d79cf22257 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:23.161076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:23.221810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:23.235007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:23.239292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25bdd6-c4ff-4222-a6f6-20d79cf22257 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:23.276369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:23.276975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:23.277253 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:23.277523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:23.278143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:23.278445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:23.278605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6ae7-a68a-4c40-87c6-b9ee6f5b4897 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:23.279896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:23.284876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 507/1001] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:06:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:23.290345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:23.321691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:23.322606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:23.323072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:23.323499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] PATH_INFO: `/v3/services/image` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:23.324259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:23.325772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:23.337491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:23.338690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:23.339625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:23.340373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 495/1002] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 16 19:06:23 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:23.345989 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:23.397128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499877c3-2a28-440c-a9b2-8658df9a170c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:23.438382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:23.439022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:23.439312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:23.439591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:23.440228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:23.440685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:23.442471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:23.447876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 508/1003] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:06:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:23.453778 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:23.462940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41a04e-0c5a-4db5-8e0d-877381d98386 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:23.481057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:23.483375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:23.502679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:23.503318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:23.503599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:23.503872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:23.504495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] RBAC: Adding query filter params (name=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:23.504794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:23.506140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:23.511470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 496/1004] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:23.517509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:23.562107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd6f2d-6c7d-4dca-8ffb-82bde22ad112 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:23.597302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:23.597826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:23.598102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:23.598374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:23.599097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] RBAC: Adding query filter params (interface=public, service_id=f8291b2fb6a2495995d4e3ff5efe418e, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:23.599408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:23.600946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:23.611549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 509/1005] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 19:06:23 2022] GET /identity/v3/endpoints?service_id=f8291b2fb6a2495995d4e3ff5efe418e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:23.612359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:23.630899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02692378-e8fd-460e-aa83-aad442aa0fde None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:23.669779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df92ed-ffff-4aaa-b49a-d95c24cde002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:23.670551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df92ed-ffff-4aaa-b49a-d95c24cde002 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:23.670823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df92ed-ffff-4aaa-b49a-d95c24cde002 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:23.671127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df92ed-ffff-4aaa-b49a-d95c24cde002 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:23.671866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df92ed-ffff-4aaa-b49a-d95c24cde002 None admin] RBAC: Adding query filter params (type=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:23.672187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df92ed-ffff-4aaa-b49a-d95c24cde002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:23.673637 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df92ed-ffff-4aaa-b49a-d95c24cde002 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:23.687273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 497/1006] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:23.717220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:23.729953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1cb92-a50a-49b5-8973-7e7e43f5daa6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:23.771086 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a913f-d1ce-44e0-b89f-37dd5848d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:23.771716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a913f-d1ce-44e0-b89f-37dd5848d885 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:23.771999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a913f-d1ce-44e0-b89f-37dd5848d885 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:23.772870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a913f-d1ce-44e0-b89f-37dd5848d885 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:23.773591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a913f-d1ce-44e0-b89f-37dd5848d885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:23.774897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a913f-d1ce-44e0-b89f-37dd5848d885 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:23.791303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 510/1007] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:06:23 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:06:25.039556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815ca3-c408-4f02-8797-d67c12564d6e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:25.040103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815ca3-c408-4f02-8797-d67c12564d6e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:25.040103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815ca3-c408-4f02-8797-d67c12564d6e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:25.041601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 498/1008] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:25.046771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff144e-f598-428b-8920-f4a59efbb73b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:25.047194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff144e-f598-428b-8920-f4a59efbb73b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:25.047368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff144e-f598-428b-8920-f4a59efbb73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:25.066078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ddff144e-f598-428b-8920-f4a59efbb73b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:25.067293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ddff144e-f598-428b-8920-f4a59efbb73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:25.139386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 511/1009] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:25.407211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61815ca3-c408-4f02-8797-d67c12564d6e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:25.470024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:25.530007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61815ca3-c408-4f02-8797-d67c12564d6e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:25.564462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824260ce-0807-40a5-95b4-883a725a4845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:25.565090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824260ce-0807-40a5-95b4-883a725a4845 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:25.565366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824260ce-0807-40a5-95b4-883a725a4845 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:25.565635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824260ce-0807-40a5-95b4-883a725a4845 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:25.566733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824260ce-0807-40a5-95b4-883a725a4845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:25.568182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824260ce-0807-40a5-95b4-883a725a4845 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:25.570306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 499/1010] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:25.576001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff144e-f598-428b-8920-f4a59efbb73b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:25.663810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:25.680924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff144e-f598-428b-8920-f4a59efbb73b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:25.716818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d99c4-7754-4605-96b3-d2e5ee4de258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:25.717462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d99c4-7754-4605-96b3-d2e5ee4de258 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:25.717745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d99c4-7754-4605-96b3-d2e5ee4de258 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:25.718021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d99c4-7754-4605-96b3-d2e5ee4de258 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:25.718700 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d99c4-7754-4605-96b3-d2e5ee4de258 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:25.720227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d99c4-7754-4605-96b3-d2e5ee4de258 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:25.751998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 512/1011] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:06:25 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:25.837470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a772-91dd-414a-a237-383842bb74f2 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:25.837874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a772-91dd-414a-a237-383842bb74f2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:25.838042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0a772-91dd-414a-a237-383842bb74f2 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:25.839707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 500/1012] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:25.845710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58a99-114c-4cb7-9893-87ea9bc25e74 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:25.846039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58a99-114c-4cb7-9893-87ea9bc25e74 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:25.846268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e58a99-114c-4cb7-9893-87ea9bc25e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:25.869089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d6e58a99-114c-4cb7-9893-87ea9bc25e74 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:25.870321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d6e58a99-114c-4cb7-9893-87ea9bc25e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:25.945248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 513/1013] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:25.968562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4bc1d-d56d-4e80-95ae-99d6b6bb6e45 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:25.968845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4bc1d-d56d-4e80-95ae-99d6b6bb6e45 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:25.969131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4bc1d-d56d-4e80-95ae-99d6b6bb6e45 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:25.970634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 501/1014] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:25.976727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7226fc-fdea-4425-83cb-1392886bc79e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:25.977021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7226fc-fdea-4425-83cb-1392886bc79e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:25.977291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7226fc-fdea-4425-83cb-1392886bc79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:25.996666 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6c7226fc-fdea-4425-83cb-1392886bc79e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:25.997867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6c7226fc-fdea-4425-83cb-1392886bc79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:26.064137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:26.079043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 514/1015] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:26.212440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4bc1d-d56d-4e80-95ae-99d6b6bb6e45 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:26.319843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4bc1d-d56d-4e80-95ae-99d6b6bb6e45 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:26.333449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:26.355825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7226fc-fdea-4425-83cb-1392886bc79e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:26.357388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b43f-4f27-49c2-a700-ea0c473c3f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:26.358011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b43f-4f27-49c2-a700-ea0c473c3f14 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:26.358290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b43f-4f27-49c2-a700-ea0c473c3f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:26.358564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63b43f-4f27-49c2-a700-ea0c473c3f14 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:26.359253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b43f-4f27-49c2-a700-ea0c473c3f14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:26.360605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63b43f-4f27-49c2-a700-ea0c473c3f14 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:26.376307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 502/1016] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:06:26 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:26.479662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7226fc-fdea-4425-83cb-1392886bc79e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:26.526655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:26.527330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:26.527616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:26.527894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:26.528493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:26.529898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:26.540469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:26.541639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:26.544114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 515/1017] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:26.548425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b43f-4f27-49c2-a700-ea0c473c3f14 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:26.653397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63b43f-4f27-49c2-a700-ea0c473c3f14 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:26.687856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:26.688831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:26.689288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:26.689738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:26.690568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:26.691093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:26.692714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:26.699500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 503/1018] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:06:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:26.704950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:26.764507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:26.810395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7a6c3-b4d9-4007-a5cc-6cc39d9192a6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:26.843932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1e5e7-e147-48f9-987e-5bd38a5fcdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:26.844538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e5e7-e147-48f9-987e-5bd38a5fcdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:26.844820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e5e7-e147-48f9-987e-5bd38a5fcdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:26.845122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1e5e7-e147-48f9-987e-5bd38a5fcdc4 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:26.845752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1e5e7-e147-48f9-987e-5bd38a5fcdc4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:26.846055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1e5e7-e147-48f9-987e-5bd38a5fcdc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:26.847451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1e5e7-e147-48f9-987e-5bd38a5fcdc4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:26.853435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 516/1019] 10.222.0.20 () {56 vars in 1112 bytes} [Fri Sep 16 19:06:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:26.858908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:26.897400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:26.966564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41c1c9-4472-4b59-b85e-275ce94b2edd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:27.001911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145df8f3-d2e7-4dc6-9532-ee2bed7dcaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:27.002523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df8f3-d2e7-4dc6-9532-ee2bed7dcaf6 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:27.002806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df8f3-d2e7-4dc6-9532-ee2bed7dcaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:27.003116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145df8f3-d2e7-4dc6-9532-ee2bed7dcaf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:27.003799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145df8f3-d2e7-4dc6-9532-ee2bed7dcaf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:27.005169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145df8f3-d2e7-4dc6-9532-ee2bed7dcaf6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:27.031113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 504/1020] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:06:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:27.982567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d3a97-4898-45df-a0a4-da08952b9472 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:27.983116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d3a97-4898-45df-a0a4-da08952b9472 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:27.983228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d3a97-4898-45df-a0a4-da08952b9472 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:27.984551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 517/1021] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:27.990129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822248ff-05da-45ed-83b4-f47b9a7a6a0e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:27.990652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822248ff-05da-45ed-83b4-f47b9a7a6a0e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:27.991309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822248ff-05da-45ed-83b4-f47b9a7a6a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:28.011396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-822248ff-05da-45ed-83b4-f47b9a7a6a0e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:28.012603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-822248ff-05da-45ed-83b4-f47b9a7a6a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:28.086697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 505/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:28.356627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d3a97-4898-45df-a0a4-da08952b9472 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:28.474399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d3a97-4898-45df-a0a4-da08952b9472 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:28.497564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:28.513218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56712c-3e93-4308-aa32-e9d01b1deecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:28.513849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56712c-3e93-4308-aa32-e9d01b1deecb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:28.514188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56712c-3e93-4308-aa32-e9d01b1deecb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:28.514470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56712c-3e93-4308-aa32-e9d01b1deecb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:28.515666 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56712c-3e93-4308-aa32-e9d01b1deecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:28.517089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56712c-3e93-4308-aa32-e9d01b1deecb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:28.519039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 518/1023] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:28.524692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822248ff-05da-45ed-83b4-f47b9a7a6a0e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:28.543945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:28.579138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98430c4-42b5-49f0-b5c8-4dbdec8cef59 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:28.579699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98430c4-42b5-49f0-b5c8-4dbdec8cef59 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:28.580003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98430c4-42b5-49f0-b5c8-4dbdec8cef59 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:28.581537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 519/1024] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:28.586641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018d6e5-baaa-4e27-aa1c-dab33b7d86ec None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:28.586930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018d6e5-baaa-4e27-aa1c-dab33b7d86ec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:28.587245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018d6e5-baaa-4e27-aa1c-dab33b7d86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:28.605473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5018d6e5-baaa-4e27-aa1c-dab33b7d86ec None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:28.606712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5018d6e5-baaa-4e27-aa1c-dab33b7d86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:28.634464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822248ff-05da-45ed-83b4-f47b9a7a6a0e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:28.669812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee721-0f08-42bc-8acd-59429c1d56ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:28.670426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee721-0f08-42bc-8acd-59429c1d56ae None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:28.670705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee721-0f08-42bc-8acd-59429c1d56ae None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:28.670979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee721-0f08-42bc-8acd-59429c1d56ae None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:28.671670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee721-0f08-42bc-8acd-59429c1d56ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:28.673087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee721-0f08-42bc-8acd-59429c1d56ae None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:28.676036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 520/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:28.695682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 506/1026] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:06:28 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:28.953369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018d6e5-baaa-4e27-aa1c-dab33b7d86ec None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:29.063694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018d6e5-baaa-4e27-aa1c-dab33b7d86ec None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:29.081432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:29.099955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:29.101620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.102017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:29.102289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] PATH_INFO: `/v3/services/image` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:29.102872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:29.104262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:29.113018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:29.113981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:29.114816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 521/1027] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 16 19:06:28 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:29.121065 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee721-0f08-42bc-8acd-59429c1d56ae None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:29.202822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:29.230970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee721-0f08-42bc-8acd-59429c1d56ae None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:29.265623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497c982-bd34-4288-9f8f-a55ab5e44874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:29.266233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497c982-bd34-4288-9f8f-a55ab5e44874 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.266511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497c982-bd34-4288-9f8f-a55ab5e44874 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:29.266781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497c982-bd34-4288-9f8f-a55ab5e44874 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:29.267500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497c982-bd34-4288-9f8f-a55ab5e44874 None admin] RBAC: Adding query filter params (name=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:29.267801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497c982-bd34-4288-9f8f-a55ab5e44874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:29.269156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497c982-bd34-4288-9f8f-a55ab5e44874 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:29.279736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 507/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:29.281004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:29.284563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0b209-a02c-47d8-9cf6-575bfbf31a1f None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.284849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0b209-a02c-47d8-9cf6-575bfbf31a1f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:29.285126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0b209-a02c-47d8-9cf6-575bfbf31a1f None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:29.286588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 508/1029] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:29.291971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176a3e-27fa-437e-8908-cc843e9793e6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.292255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176a3e-27fa-437e-8908-cc843e9793e6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:29.292530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72176a3e-27fa-437e-8908-cc843e9793e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:29.310541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-72176a3e-27fa-437e-8908-cc843e9793e6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:29.311749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-72176a3e-27fa-437e-8908-cc843e9793e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:29.384243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 509/1030] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:29.386631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61923dc6-6a3d-4cc3-b005-7396f35ed385 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:29.420298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:29.420903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.421179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:29.421449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:29.422067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] RBAC: Adding query filter params (type=image) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:29.422368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:29.423744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:29.439742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 522/1031] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:29.441011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72176a3e-27fa-437e-8908-cc843e9793e6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:29.510346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:29.544369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72176a3e-27fa-437e-8908-cc843e9793e6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:29.578614 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:29.579241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.579518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:29.579786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:29.580477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] RBAC: Adding query filter params (interface=public, service_id=71e5bca92ffd4646bd24e3a9600eae17, region_id=RegionOne) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:29.580780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:29.582122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:29.591704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 510/1032] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 19:06:29 2022] GET /identity/v3/endpoints?service_id=71e5bca92ffd4646bd24e3a9600eae17&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:29.592888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:29.645521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:29.664343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:29.705671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d9215-2e9a-496b-8174-62103989cc7f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:29.746076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47cab7-897e-4d2e-a151-443b6bba8620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:29.747020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47cab7-897e-4d2e-a151-443b6bba8620 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.747509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47cab7-897e-4d2e-a151-443b6bba8620 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:29.747982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47cab7-897e-4d2e-a151-443b6bba8620 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:29.748800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47cab7-897e-4d2e-a151-443b6bba8620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:29.750368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47cab7-897e-4d2e-a151-443b6bba8620 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:29.758075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 523/1033] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:06:29 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:06:29.782387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e270ff6-60d4-4c56-aa45-d4215b2f4e50 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:29.816380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:29.823373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd988-6ffc-403f-9bde-499c465156d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:29.824022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd988-6ffc-403f-9bde-499c465156d5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.824298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd988-6ffc-403f-9bde-499c465156d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:29.824568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dd988-6ffc-403f-9bde-499c465156d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:29.836929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35dd988-6ffc-403f-9bde-499c465156d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-d35dd988-6ffc-403f-9bde-499c465156d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:29.841804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:29.842787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:29.844129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 511/1034] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 19:06:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:29.849061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47cab7-897e-4d2e-a151-443b6bba8620 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:29.962011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47cab7-897e-4d2e-a151-443b6bba8620 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:29.972973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:29.998770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:29.999418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:29.999701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:30.000036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:30.000712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:30.001019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:30.002378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:30.011078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 524/1035] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 19:06:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:30.016687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd988-6ffc-403f-9bde-499c465156d5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:30.120941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dd988-6ffc-403f-9bde-499c465156d5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:30.155091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:30.155716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:30.155993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:30.156270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:30.166189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:30.167655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:30.182495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:30.183711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:30.184826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:30.184826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:30.184826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:30.187069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 512/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:30.189482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:30.292309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f268a68-5b22-4840-adf6-52571e0f5d35 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:30.327007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:30.327641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:30.327925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:30.328204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:30.328846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:30.329154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:30.330520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:30.347902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 525/1037] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:30.349120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:30.399111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:30.462380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7410bb-2193-4814-baa3-31f9595d3fdf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:30.497525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:30.498156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:30.498434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:30.498706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:30.507373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:30.509041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:30.520086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:30.521046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:30.522575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 513/1038] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:06:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:30.528902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:30.560822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:30.632328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d9597-4035-4aba-8397-af556d02721b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:30.669584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa3a18-4a59-4bfe-8dfd-64e7e5065419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:30.670113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa3a18-4a59-4bfe-8dfd-64e7e5065419 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:30.670392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa3a18-4a59-4bfe-8dfd-64e7e5065419 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:30.670665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa3a18-4a59-4bfe-8dfd-64e7e5065419 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:30.671418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa3a18-4a59-4bfe-8dfd-64e7e5065419 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:30.671723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa3a18-4a59-4bfe-8dfd-64e7e5065419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:30.673139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa3a18-4a59-4bfe-8dfd-64e7e5065419 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:30.696093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 526/1039] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:06:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:30.697489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:30.797787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fcadf-a2d4-4c7c-9557-78051e5a9d6d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:30.800106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:30.837770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254bc96-9c2a-45e3-b001-a1001bf43a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:30.838390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254bc96-9c2a-45e3-b001-a1001bf43a25 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:30.838667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254bc96-9c2a-45e3-b001-a1001bf43a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:30.838938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254bc96-9c2a-45e3-b001-a1001bf43a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:30.906968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254bc96-9c2a-45e3-b001-a1001bf43a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:30.908430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254bc96-9c2a-45e3-b001-a1001bf43a25 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:30.929848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb915c46-f32f-4331-8a97-12643e2562b3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:30.930131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb915c46-f32f-4331-8a97-12643e2562b3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:30.930323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb915c46-f32f-4331-8a97-12643e2562b3 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:30.931825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 527/1040] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:30.936681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b17ad4-c48a-4c59-89e8-e8e5e65ff6c6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:30.936949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b17ad4-c48a-4c59-89e8-e8e5e65ff6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:30.937225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b17ad4-c48a-4c59-89e8-e8e5e65ff6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:30.955336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-32b17ad4-c48a-4c59-89e8-e8e5e65ff6c6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:30.956557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-32b17ad4-c48a-4c59-89e8-e8e5e65ff6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:31.019064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 514/1041] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 19:06:31.021404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254bc96-9c2a-45e3-b001-a1001bf43a25 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.025265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:31.036767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 528/1042] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:31.126367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254bc96-9c2a-45e3-b001-a1001bf43a25 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.160870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.161480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.161765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.162043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.172922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:31.174356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:31.189760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:31.190642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:31.196049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:31.196049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:31.196049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:31.196049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 515/1043] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:31.197930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b17ad4-c48a-4c59-89e8-e8e5e65ff6c6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.220135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:31.302466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b17ad4-c48a-4c59-89e8-e8e5e65ff6c6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.308611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.341175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.342091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.342633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.342912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.343581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:31.343882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:31.346161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:31.361225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 529/1044] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:31.367474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.374390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:31.423041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d3e68-38fe-4e44-b502-331f7763ca60 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.453742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:31.465031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0b2c-3c8b-4269-8b87-7d5cb78e6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.465887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0b2c-3c8b-4269-8b87-7d5cb78e6124 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.466494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0b2c-3c8b-4269-8b87-7d5cb78e6124 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.466782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e0b2c-3c8b-4269-8b87-7d5cb78e6124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.476664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b75a1-551d-466a-8243-94bc4f90dd8f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.478297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e0b2c-3c8b-4269-8b87-7d5cb78e6124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-473e0b2c-3c8b-4269-8b87-7d5cb78e6124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:31.483568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:31.484493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:31.485347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 516/1045] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:31.490704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0b2c-3c8b-4269-8b87-7d5cb78e6124 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.517852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.518627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.518911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.519323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.527184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:31.528652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:31.541093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:31.542100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:31.543075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 530/1046] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:31.547966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.597723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e0b2c-3c8b-4269-8b87-7d5cb78e6124 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.614495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:31.635062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.635663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.635940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.636212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.636872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:31.637176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:31.638519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:31.648122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 517/1047] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:31.650447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe50bf-5197-46e2-a569-1ecac800328b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.653955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.684735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.685344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.685621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.685906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.686569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:31.686894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:31.688323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:31.698431 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:31.707540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 531/1048] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:31.708367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.764347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f686-02a9-4c0e-b213-3f2a981da189 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.801655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc033527-3eb3-4ad4-8d37-8ba1b0bc75ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.802287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc033527-3eb3-4ad4-8d37-8ba1b0bc75ad None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.802568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc033527-3eb3-4ad4-8d37-8ba1b0bc75ad None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.802845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc033527-3eb3-4ad4-8d37-8ba1b0bc75ad None admin] PATH_INFO: `/v3/users/56e08645c2584a95ab35826c5b0415b7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.812467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf446c6-b7bc-4980-9413-0c00974953c4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.818004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc033527-3eb3-4ad4-8d37-8ba1b0bc75ad None admin] RBAC: Authorizing `identity:get_user(user_id=56e08645c2584a95ab35826c5b0415b7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:31.819693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc033527-3eb3-4ad4-8d37-8ba1b0bc75ad None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:31.821489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 518/1049] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/users/56e08645c2584a95ab35826c5b0415b7 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:31.827815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc033527-3eb3-4ad4-8d37-8ba1b0bc75ad None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:31.853597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e84f74-20bd-4b7d-809a-1db674c189b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.854320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84f74-20bd-4b7d-809a-1db674c189b4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.854675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84f74-20bd-4b7d-809a-1db674c189b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.855037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e84f74-20bd-4b7d-809a-1db674c189b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.855852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e84f74-20bd-4b7d-809a-1db674c189b4 None admin] RBAC: Adding query filter params (role.id=0dc287fb7c68485487b0ee297f0b78ee, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=c915a2b20a2c48a682ef08528e482b96) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:31.856229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e84f74-20bd-4b7d-809a-1db674c189b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:31.857727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e84f74-20bd-4b7d-809a-1db674c189b4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:31.875029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 532/1050] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/role_assignments?user.id=c915a2b20a2c48a682ef08528e482b96&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0dc287fb7c68485487b0ee297f0b78ee => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:31.875273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:31.948326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc033527-3eb3-4ad4-8d37-8ba1b0bc75ad None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:31.949786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3ef0-0ea3-4b61-8a17-3dbb89366877 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.950022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3ef0-0ea3-4b61-8a17-3dbb89366877 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.950305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3ef0-0ea3-4b61-8a17-3dbb89366877 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.951740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 533/1051] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:31.957331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083eafe-0c38-407d-b477-8e24e0e8188a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.957620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083eafe-0c38-407d-b477-8e24e0e8188a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.957906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083eafe-0c38-407d-b477-8e24e0e8188a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:31.977351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f083eafe-0c38-407d-b477-8e24e0e8188a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:31.978575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f083eafe-0c38-407d-b477-8e24e0e8188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:31.988416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0932f6-787c-44ca-b4ac-6cff0e6a07d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:31.989030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0932f6-787c-44ca-b4ac-6cff0e6a07d9 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:31.989308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0932f6-787c-44ca-b4ac-6cff0e6a07d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:31.989580 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0932f6-787c-44ca-b4ac-6cff0e6a07d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:32.042622 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:32.054519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 534/1052] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:32.071183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0932f6-787c-44ca-b4ac-6cff0e6a07d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:32.072633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0932f6-787c-44ca-b4ac-6cff0e6a07d9 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:32.108532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:32.182085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 519/1053] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 19:06:32.195040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083eafe-0c38-407d-b477-8e24e0e8188a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:32.321791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083eafe-0c38-407d-b477-8e24e0e8188a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:32.327666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0932f6-787c-44ca-b4ac-6cff0e6a07d9 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:32.363232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dd7f2-381b-4add-aa93-875bb9939cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:32.364124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd7f2-381b-4add-aa93-875bb9939cca None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:32.364567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd7f2-381b-4add-aa93-875bb9939cca None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:32.364846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2dd7f2-381b-4add-aa93-875bb9939cca None admin] PATH_INFO: `/v3/projects/4cd11401139340c9a62398bd96c7ae8c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:32.366637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dd7f2-381b-4add-aa93-875bb9939cca None admin] RBAC: Authorizing `identity:get_project(project_id=4cd11401139340c9a62398bd96c7ae8c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:32.368115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2dd7f2-381b-4add-aa93-875bb9939cca None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:32.371057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 535/1054] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:06:32 2022] GET /identity/v3/projects/4cd11401139340c9a62398bd96c7ae8c => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:32.375913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dd7f2-381b-4add-aa93-875bb9939cca None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:32.454377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0932f6-787c-44ca-b4ac-6cff0e6a07d9 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:32.460369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:32.509629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:32.510382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:32.510664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:32.510940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:32.511568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:32.512936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:32.513097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2dd7f2-381b-4add-aa93-875bb9939cca None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:32.516257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:32.525790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:32.526803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 19:06:32.527694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:32.531311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 520/1055] 10.222.0.20 () {56 vars in 1105 bytes} [Fri Sep 16 19:06:32 2022] GET /identity/v3/services/image => generated 86 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:32.532929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:32.554441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:32.555084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:32.555649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:32.555760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:32.556463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=4cd11401139340c9a62398bd96c7ae8c, user.id=56e08645c2584a95ab35826c5b0415b7) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:32.556775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:32.558298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:32.565059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 536/1056] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:32 2022] GET /identity/v3/role_assignments?user.id=56e08645c2584a95ab35826c5b0415b7&scope.project.id=4cd11401139340c9a62398bd96c7ae8c&role.id=0f99070a6a88400199520fccd98977b6 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:32.644802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d67b7b-07b0-4890-8b9d-0aa45ccfdab3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:32.682382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:32.683024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:32.683318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:32.683593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:32.684237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:32.684543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:32.685924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:32.696733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 521/1057] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:32.698448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:32.809799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a1b43-f784-4e88-b0e4-76649a22499e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:32.835944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:32.845918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5402a6-be69-44fb-9c3f-c1fe86a6b6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:32.846532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5402a6-be69-44fb-9c3f-c1fe86a6b6bc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:32.846813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5402a6-be69-44fb-9c3f-c1fe86a6b6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:32.847119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5402a6-be69-44fb-9c3f-c1fe86a6b6bc None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:32.847745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5402a6-be69-44fb-9c3f-c1fe86a6b6bc None admin] RBAC: Adding query filter params (type=image) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:32.848047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5402a6-be69-44fb-9c3f-c1fe86a6b6bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:32.849395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5402a6-be69-44fb-9c3f-c1fe86a6b6bc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:32.859058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 537/1058] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:32.860383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:32.926429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:32.966785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c594b-631b-4e74-a442-8717ee5ca1b4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:33.003118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9725b1-5d95-4e23-a740-2b3852ce9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:33.003727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9725b1-5d95-4e23-a740-2b3852ce9beb None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:33.004007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9725b1-5d95-4e23-a740-2b3852ce9beb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:33.004281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9725b1-5d95-4e23-a740-2b3852ce9beb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:33.004957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9725b1-5d95-4e23-a740-2b3852ce9beb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:33.006342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9725b1-5d95-4e23-a740-2b3852ce9beb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:33.032894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 522/1059] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:06:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:06:34.091637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8bbf4-d83e-494f-94ef-97fcdf89f7ab None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:34.092271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8bbf4-d83e-494f-94ef-97fcdf89f7ab None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:34.092271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8bbf4-d83e-494f-94ef-97fcdf89f7ab None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:34.093551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 538/1060] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:34.098594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0286be-2f04-4c47-9ec0-9ac566348731 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:34.099110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0286be-2f04-4c47-9ec0-9ac566348731 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:34.099207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0286be-2f04-4c47-9ec0-9ac566348731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:34.118007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ea0286be-2f04-4c47-9ec0-9ac566348731 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:34.119199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ea0286be-2f04-4c47-9ec0-9ac566348731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:34.193951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 523/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:34.492117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8bbf4-d83e-494f-94ef-97fcdf89f7ab None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:34.606300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8bbf4-d83e-494f-94ef-97fcdf89f7ab None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:34.644793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a46d9-bd73-4edf-9c66-7eb3382bab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:34.645434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a46d9-bd73-4edf-9c66-7eb3382bab85 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:34.645721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a46d9-bd73-4edf-9c66-7eb3382bab85 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:34.645998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a46d9-bd73-4edf-9c66-7eb3382bab85 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:34.658124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a46d9-bd73-4edf-9c66-7eb3382bab85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-dd7a46d9-bd73-4edf-9c66-7eb3382bab85 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:34.663988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:34.665032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:34.665938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 539/1062] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 19:06:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:34.672715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0286be-2f04-4c47-9ec0-9ac566348731 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:34.722139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:34.728483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84cd9-edf3-4478-9c6d-b33b23f871b4 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:34.728786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84cd9-edf3-4478-9c6d-b33b23f871b4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:34.729053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84cd9-edf3-4478-9c6d-b33b23f871b4 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:34.730415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 540/1063] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:34.737208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223279c-7188-4151-8881-b8b37599361c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:34.737814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223279c-7188-4151-8881-b8b37599361c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:34.738251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223279c-7188-4151-8881-b8b37599361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:34.757288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3223279c-7188-4151-8881-b8b37599361c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:34.759030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3223279c-7188-4151-8881-b8b37599361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:34.794628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0286be-2f04-4c47-9ec0-9ac566348731 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:34.820153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:34.837851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:34.838475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:34.838765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:34.839180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:34.839864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:34.840171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:34.841550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:34.847817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 541/1064] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:34.854458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 524/1065] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 19:06:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:34.859984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223279c-7188-4151-8881-b8b37599361c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:34.978953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223279c-7188-4151-8881-b8b37599361c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.017610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.018250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.018581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.018860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.035079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.035300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:35.051202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:35.052239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:35.054164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:35.054164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:35.054164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:35.054164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 542/1066] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:35.064299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.172868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.201150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3335292-1821-4702-aaa6-e4d43bbd7379 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.211922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:35.216477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:35.248006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9bc74-7001-4fb4-ae99-beabd1601c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.248694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9bc74-7001-4fb4-ae99-beabd1601c8f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.249077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9bc74-7001-4fb4-ae99-beabd1601c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.249455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9bc74-7001-4fb4-ae99-beabd1601c8f None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.250212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9bc74-7001-4fb4-ae99-beabd1601c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:35.250623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9bc74-7001-4fb4-ae99-beabd1601c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.252144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9bc74-7001-4fb4-ae99-beabd1601c8f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:35.264987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 525/1067] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:35.266794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481308dd-f952-45c5-9635-30817d9d1517 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.267216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481308dd-f952-45c5-9635-30817d9d1517 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.267636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481308dd-f952-45c5-9635-30817d9d1517 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.269105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 526/1068] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:35.273341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481308dd-f952-45c5-9635-30817d9d1517 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.310028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5bbf9-31c8-4300-9729-df2df1701d23 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.345431 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912a79c-7e84-4b25-a526-3674cdcc1b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.346066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912a79c-7e84-4b25-a526-3674cdcc1b8b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.346347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912a79c-7e84-4b25-a526-3674cdcc1b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.346626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912a79c-7e84-4b25-a526-3674cdcc1b8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.358043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e912a79c-7e84-4b25-a526-3674cdcc1b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e912a79c-7e84-4b25-a526-3674cdcc1b8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:35.362824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:35.363936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:35.364777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 543/1069] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:35.365542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd304f-43f1-45d5-8711-50c78afef8f7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.365542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd304f-43f1-45d5-8711-50c78afef8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.365681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd304f-43f1-45d5-8711-50c78afef8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.383551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e7dd304f-43f1-45d5-8711-50c78afef8f7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:35.384521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481308dd-f952-45c5-9635-30817d9d1517 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.384734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e7dd304f-43f1-45d5-8711-50c78afef8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:35.420033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.420660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.420940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.421213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.428252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.429693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:35.441843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:35.442960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 527/1070] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:35.444375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.459837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 544/1071] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:35.460807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd304f-43f1-45d5-8711-50c78afef8f7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.476132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:35.486100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:35.556792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720172b4-d39c-4c71-80ee-ab46d82b9399 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.562877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd304f-43f1-45d5-8711-50c78afef8f7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.593158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.593915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.594255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.594558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.595231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:35.595671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.596935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:35.601508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.602132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.602416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.602693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.603462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:35.603768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.605190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:35.607663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 528/1072] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:35.613303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.628078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 545/1073] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:35.633799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.714887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:35.719299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:35.728805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678e869-3467-4ce2-8a3c-b2d2aead7bd5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.739606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba3ed-8093-451b-ae2f-dd40bef67e3e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.764085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ed5c-58d1-4ddb-9bfa-640a14091bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.764717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ed5c-58d1-4ddb-9bfa-640a14091bae None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.764995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ed5c-58d1-4ddb-9bfa-640a14091bae None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.765268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02ed5c-58d1-4ddb-9bfa-640a14091bae None admin] PATH_INFO: `/v3/users/56e08645c2584a95ab35826c5b0415b7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.766475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ed5c-58d1-4ddb-9bfa-640a14091bae None admin] RBAC: Authorizing `identity:get_user(user_id=56e08645c2584a95ab35826c5b0415b7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.767930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02ed5c-58d1-4ddb-9bfa-640a14091bae None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:35.769517 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 529/1074] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/users/56e08645c2584a95ab35826c5b0415b7 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:35.770344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ed5c-58d1-4ddb-9bfa-640a14091bae None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.776640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.778072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.778372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.778715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.790340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.791819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:35.807599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:35.808719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:35.809633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:35.809633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:35.809633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:35.809633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 546/1075] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:35.809633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.877333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02ed5c-58d1-4ddb-9bfa-640a14091bae None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.909038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054c80-ada2-4e61-9fe7-179749ae8715 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:35.913223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e647-fea3-40fb-baa2-efa79b70a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.913826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e647-fea3-40fb-baa2-efa79b70a75e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.914108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e647-fea3-40fb-baa2-efa79b70a75e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.914386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1e647-fea3-40fb-baa2-efa79b70a75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.940067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:35.942127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:35.946274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e4cb0-0978-4f82-b3f0-7259ba4ffdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:35.946904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4cb0-0978-4f82-b3f0-7259ba4ffdee None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:35.947217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4cb0-0978-4f82-b3f0-7259ba4ffdee None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:35.947501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4cb0-0978-4f82-b3f0-7259ba4ffdee None admin] PATH_INFO: `/v3/projects/4cd11401139340c9a62398bd96c7ae8c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:35.948624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e4cb0-0978-4f82-b3f0-7259ba4ffdee None admin] RBAC: Authorizing `identity:get_project(project_id=4cd11401139340c9a62398bd96c7ae8c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.950051 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e4cb0-0978-4f82-b3f0-7259ba4ffdee None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:35.951728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 547/1076] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/projects/4cd11401139340c9a62398bd96c7ae8c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:35.952485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e4cb0-0978-4f82-b3f0-7259ba4ffdee None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:35.985068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1e647-fea3-40fb-baa2-efa79b70a75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:35.986621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1e647-fea3-40fb-baa2-efa79b70a75e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:36.050971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e4cb0-0978-4f82-b3f0-7259ba4ffdee None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:36.085549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:36.086072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:36.086348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:36.086617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:36.087277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 530/1077] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:06:36.087429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:36.087592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:36.088101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e647-fea3-40fb-baa2-efa79b70a75e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:36.089022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:36.101462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 548/1078] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:36.102271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:36.145621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:36.164400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:36.188219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1e647-fea3-40fb-baa2-efa79b70a75e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:36.205579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19e99f-609b-444b-a4df-a647bd2e6682 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:36.222555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217973a4-feb6-4b83-9b97-49e9508e9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:36.223245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217973a4-feb6-4b83-9b97-49e9508e9660 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:36.223526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217973a4-feb6-4b83-9b97-49e9508e9660 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:36.224046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217973a4-feb6-4b83-9b97-49e9508e9660 None admin] PATH_INFO: `/v3/projects/4cd11401139340c9a62398bd96c7ae8c/users/56e08645c2584a95ab35826c5b0415b7/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:36.226647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217973a4-feb6-4b83-9b97-49e9508e9660 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cd11401139340c9a62398bd96c7ae8c, user_id=56e08645c2584a95ab35826c5b0415b7, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:36.228112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217973a4-feb6-4b83-9b97-49e9508e9660 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:36.240960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 531/1079] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:06:36 2022] PUT /identity/v3/projects/4cd11401139340c9a62398bd96c7ae8c/users/56e08645c2584a95ab35826c5b0415b7/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:06:36.241552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:36.241765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217973a4-feb6-4b83-9b97-49e9508e9660 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:36.242193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:36.242475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:36.242755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:36.253980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:36.255528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:36.273113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:36.274148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:36.275657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:36.275657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:36.275657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:36.275657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 549/1080] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:36.280646 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:36.376917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217973a4-feb6-4b83-9b97-49e9508e9660 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:36.395464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:36.408839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ec8ca-65eb-4f35-9fe3-b6c869c1a777 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:36.422338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:36.423004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:36.423361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:36.423649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:36.423981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:36.432423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:36.437557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:36.449037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:36.450164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:36.451177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 532/1081] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:36.453520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:36.454131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:36.454411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:36.454686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:36.455805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:36.456619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:36.456925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:36.458297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:36.471456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 550/1082] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:36.571696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473ccc6-1d51-49a7-93ff-c3b7620dec35 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:36.609092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48250392-058a-4759-87a4-c054adb0915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:36.609721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48250392-058a-4759-87a4-c054adb0915e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:36.610000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48250392-058a-4759-87a4-c054adb0915e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:36.610275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48250392-058a-4759-87a4-c054adb0915e None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:36.611011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48250392-058a-4759-87a4-c054adb0915e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:36.611330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48250392-058a-4759-87a4-c054adb0915e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:36.612797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48250392-058a-4759-87a4-c054adb0915e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:36.627340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 533/1083] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:36.633291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:36.743934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bfe41-781c-4460-97ee-58b36d6ebfd9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:36.781606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a89e3d-a25e-4218-84f2-a486dc3cd76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:36.782618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a89e3d-a25e-4218-84f2-a486dc3cd76e None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:36.783182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a89e3d-a25e-4218-84f2-a486dc3cd76e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:36.783467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a89e3d-a25e-4218-84f2-a486dc3cd76e None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/c915a2b20a2c48a682ef08528e482b96/roles/0dc287fb7c68485487b0ee297f0b78ee` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:36.785609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a89e3d-a25e-4218-84f2-a486dc3cd76e None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=c915a2b20a2c48a682ef08528e482b96, role_id=0dc287fb7c68485487b0ee297f0b78ee)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:36.787127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a89e3d-a25e-4218-84f2-a486dc3cd76e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:36.801593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 551/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:06:36 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/c915a2b20a2c48a682ef08528e482b96/roles/0dc287fb7c68485487b0ee297f0b78ee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:06:38.450773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010b43-a63e-4d98-a9e6-8ab85767cff7 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:38.451227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010b43-a63e-4d98-a9e6-8ab85767cff7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:38.451357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d010b43-a63e-4d98-a9e6-8ab85767cff7 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:38.452706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 534/1085] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:38.457937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea27b-d672-4959-b4a3-989eeb797280 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:38.458338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea27b-d672-4959-b4a3-989eeb797280 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:38.458467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea27b-d672-4959-b4a3-989eeb797280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:38.476585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0e8ea27b-d672-4959-b4a3-989eeb797280 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:38.477749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0e8ea27b-d672-4959-b4a3-989eeb797280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:38.503271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:38.545392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 552/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:38.814927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d010b43-a63e-4d98-a9e6-8ab85767cff7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:38.859954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:38.919506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d010b43-a63e-4d98-a9e6-8ab85767cff7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:38.936122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb914a-a88c-4ed7-bb60-86d0e051c0ce None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:38.936409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb914a-a88c-4ed7-bb60-86d0e051c0ce None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:38.936703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb914a-a88c-4ed7-bb60-86d0e051c0ce None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:38.938060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 553/1087] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:06:38.942952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ac81-8de3-46ec-adae-5b3387feede0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:38.943336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ac81-8de3-46ec-adae-5b3387feede0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:38.943654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543ac81-8de3-46ec-adae-5b3387feede0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:38.953789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd467e-ec48-4d29-adb0-5848675df7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:38.954420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd467e-ec48-4d29-adb0-5848675df7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:38.954700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd467e-ec48-4d29-adb0-5848675df7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:38.954977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd467e-ec48-4d29-adb0-5848675df7d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:38.961166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8543ac81-8de3-46ec-adae-5b3387feede0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:38.962361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8543ac81-8de3-46ec-adae-5b3387feede0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:38.965066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd467e-ec48-4d29-adb0-5848675df7d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-bbfd467e-ec48-4d29-adb0-5848675df7d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:38.969876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:38.970839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:38.971772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 535/1088] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:38.977600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd467e-ec48-4d29-adb0-5848675df7d3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.031724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 554/1089] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:06:39.072618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:39.076640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd467e-ec48-4d29-adb0-5848675df7d3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.111465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.112072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.112360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.112636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.113301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:39.113606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:39.114964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:39.123801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 536/1090] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:39.129729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ac81-8de3-46ec-adae-5b3387feede0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.218803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:39.227876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543ac81-8de3-46ec-adae-5b3387feede0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.261792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70283e1-8213-4bb4-b26d-1f8d65d829dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.262424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70283e1-8213-4bb4-b26d-1f8d65d829dd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.262708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70283e1-8213-4bb4-b26d-1f8d65d829dd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.262984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70283e1-8213-4bb4-b26d-1f8d65d829dd None admin] PATH_INFO: `/v3/users/56e08645c2584a95ab35826c5b0415b7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.264123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70283e1-8213-4bb4-b26d-1f8d65d829dd None admin] RBAC: Authorizing `identity:get_user(user_id=56e08645c2584a95ab35826c5b0415b7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:39.265552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70283e1-8213-4bb4-b26d-1f8d65d829dd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:39.267160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 555/1091] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/users/56e08645c2584a95ab35826c5b0415b7 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:39.272898 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.301790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70283e1-8213-4bb4-b26d-1f8d65d829dd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.376029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569007e2-ac51-4fcb-a234-335b3501b1fe None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.401749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70283e1-8213-4bb4-b26d-1f8d65d829dd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.409785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c068e-16b7-4e0e-8e90-88b2255895d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.410390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c068e-16b7-4e0e-8e90-88b2255895d4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.410673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c068e-16b7-4e0e-8e90-88b2255895d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.410950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c068e-16b7-4e0e-8e90-88b2255895d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.438981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:39.441922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c50ff3-e47d-49fa-86b0-55605446381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.442564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c50ff3-e47d-49fa-86b0-55605446381b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.442854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c50ff3-e47d-49fa-86b0-55605446381b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.443682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c50ff3-e47d-49fa-86b0-55605446381b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.454206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c50ff3-e47d-49fa-86b0-55605446381b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d2c50ff3-e47d-49fa-86b0-55605446381b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:06:39.459577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:39.461112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:39.461952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 556/1092] 10.222.0.20 () {56 vars in 1120 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:39.466470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c50ff3-e47d-49fa-86b0-55605446381b None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.481430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c068e-16b7-4e0e-8e90-88b2255895d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:39.482888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c068e-16b7-4e0e-8e90-88b2255895d4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:39.488864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:39.565505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c50ff3-e47d-49fa-86b0-55605446381b None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.580058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 537/1093] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 19:06:39.586842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c068e-16b7-4e0e-8e90-88b2255895d4 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.600216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.601071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.601692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.601692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.602267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:39.602565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:39.603944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:39.611820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 557/1094] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:39.617568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.644590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:39.685314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c068e-16b7-4e0e-8e90-88b2255895d4 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.699600 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:39.719503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fda6d-1ddb-400e-a0b2-b1460bfb95e1 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.720666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ba28-7671-41ff-abce-ff0ea324c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.721457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ba28-7671-41ff-abce-ff0ea324c68b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.722495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ba28-7671-41ff-abce-ff0ea324c68b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.722779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8ba28-7671-41ff-abce-ff0ea324c68b None admin] PATH_INFO: `/v3/projects/4cd11401139340c9a62398bd96c7ae8c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.723927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8ba28-7671-41ff-abce-ff0ea324c68b None admin] RBAC: Authorizing `identity:get_project(project_id=4cd11401139340c9a62398bd96c7ae8c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:39.726137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8ba28-7671-41ff-abce-ff0ea324c68b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:39.727839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 538/1095] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/projects/4cd11401139340c9a62398bd96c7ae8c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:39.733862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ba28-7671-41ff-abce-ff0ea324c68b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.753853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.754485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.754768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.755076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.766054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:39.767560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:39.782034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:39.783075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:39.783980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:39.783980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:39.783980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:39.783980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 558/1096] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:06:39.788854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:39.834767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8ba28-7671-41ff-abce-ff0ea324c68b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.861826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:39.870129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.870725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.871021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.871301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.872019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=4cd11401139340c9a62398bd96c7ae8c, user.id=56e08645c2584a95ab35826c5b0415b7) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:39.872323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:39.873729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:39.879677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 539/1097] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/role_assignments?user.id=56e08645c2584a95ab35826c5b0415b7&scope.project.id=4cd11401139340c9a62398bd96c7ae8c&role.id=0f99070a6a88400199520fccd98977b6 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:39.891970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034541b3-144f-4fec-a42a-711c09f2da5c None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:39.929451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:39.929987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:39.930269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:39.930545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:39.931250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:39.931562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:39.932970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:39.934751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:39.952035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 559/1098] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:39.953370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:40.065977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c292f8-3343-4c01-9e4b-27217cafc78a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:40.101324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:40.101951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:40.102227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:40.102500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:40.109965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:40.111428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:06:40.122727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:40.124570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:06:40.126414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 540/1099] 10.222.0.20 () {56 vars in 1093 bytes} [Fri Sep 16 19:06:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:40.131540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:40.231143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916024a6-a77d-4902-807d-bdcdea222b2e None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:40.265180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:40.265787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:40.266064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:40.266333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:40.267074 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:40.267384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:40.268819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:40.286717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 560/1100] 10.222.0.20 () {56 vars in 1133 bytes} [Fri Sep 16 19:06:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:40.293023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:40.344915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:40.393024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd8b7-4741-430e-ab1b-9f72fb9402ff None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:40.426227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432fa6-5cae-4398-b77b-af4e8e01117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:40.427291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432fa6-5cae-4398-b77b-af4e8e01117c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:40.428123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432fa6-5cae-4398-b77b-af4e8e01117c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:40.428531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd432fa6-5cae-4398-b77b-af4e8e01117c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:40.495050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432fa6-5cae-4398-b77b-af4e8e01117c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:40.496420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd432fa6-5cae-4398-b77b-af4e8e01117c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:40.545754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:40.592955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 541/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:06:40.598806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:40.651540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:40.698480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8178eaa-41f5-40b9-bb95-81cb96753c88 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:40.732826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:40.733450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:40.733732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:40.734006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:40.743909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:40.745385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:06:40.760524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:40.761561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:06:40.762483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:06:40.762483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:06:40.762483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:40.762483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 561/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:40.767408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432fa6-5cae-4398-b77b-af4e8e01117c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:40.865685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd432fa6-5cae-4398-b77b-af4e8e01117c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:40.898397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:40.899019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:40.899303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:40.899580 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:40.900217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:40.900518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:40.901865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:40.913166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 542/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:40.918916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:41.017097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a0c7-ff84-449f-856a-6557231975fd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:41.019385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:41.052048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:41.052746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:41.053025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:41.053292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:41.059849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:41.061268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:06:41.072763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:06:41.073812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:06:41.075376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 562/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:06:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:06:41.079729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:41.096265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:41.181276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e9e2d-2554-453b-bf96-b35ef75ad8b7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:41.214420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d91f1c-014f-44cc-a154-8e04169a71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:41.215045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91f1c-014f-44cc-a154-8e04169a71bb None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:41.215329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91f1c-014f-44cc-a154-8e04169a71bb None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:41.215603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d91f1c-014f-44cc-a154-8e04169a71bb None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:41.216290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d91f1c-014f-44cc-a154-8e04169a71bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:41.216598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d91f1c-014f-44cc-a154-8e04169a71bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:41.218016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d91f1c-014f-44cc-a154-8e04169a71bb None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:41.229831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 543/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:41.235751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:41.335382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7c24-81aa-4fd0-9b9f-e279f6940ff9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:41.368508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccccf1-6ca1-45d8-a265-8c904e9c460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:41.369109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccccf1-6ca1-45d8-a265-8c904e9c460f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:41.369389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccccf1-6ca1-45d8-a265-8c904e9c460f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:41.369663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccccf1-6ca1-45d8-a265-8c904e9c460f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:41.370376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccccf1-6ca1-45d8-a265-8c904e9c460f None admin] RBAC: Adding query filter params (role.id=0dc287fb7c68485487b0ee297f0b78ee, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=c915a2b20a2c48a682ef08528e482b96) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:41.370682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccccf1-6ca1-45d8-a265-8c904e9c460f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:41.372208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccccf1-6ca1-45d8-a265-8c904e9c460f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:41.378039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 563/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:41 2022] GET /identity/v3/role_assignments?user.id=c915a2b20a2c48a682ef08528e482b96&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0dc287fb7c68485487b0ee297f0b78ee => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:42.074320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd71e-4c13-491f-a19f-6d671b9a3ead None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:42.076675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd71e-4c13-491f-a19f-6d671b9a3ead None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:42.076675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd71e-4c13-491f-a19f-6d671b9a3ead None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:42.076675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 544/1107] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:42.082360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8196bf-843b-4e62-a421-888c55c64eb2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:42.082811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8196bf-843b-4e62-a421-888c55c64eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:42.082907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8196bf-843b-4e62-a421-888c55c64eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:42.102807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8e8196bf-843b-4e62-a421-888c55c64eb2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:42.104050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8e8196bf-843b-4e62-a421-888c55c64eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:42.127687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:42.173813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 564/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:42.440587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd71e-4c13-491f-a19f-6d671b9a3ead None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:42.510155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:42.539880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd71e-4c13-491f-a19f-6d671b9a3ead None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:42.572330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6981a2b-2605-470f-91e0-0eb55ba9f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:42.572939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981a2b-2605-470f-91e0-0eb55ba9f073 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:42.573219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981a2b-2605-470f-91e0-0eb55ba9f073 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:42.573492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6981a2b-2605-470f-91e0-0eb55ba9f073 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:42.574577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6981a2b-2605-470f-91e0-0eb55ba9f073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:42.576024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6981a2b-2605-470f-91e0-0eb55ba9f073 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:42.577563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 545/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:42.583364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8196bf-843b-4e62-a421-888c55c64eb2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:42.680967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8196bf-843b-4e62-a421-888c55c64eb2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:42.715727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74395-bff6-4a70-a35c-e25148ddc70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:42.716326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74395-bff6-4a70-a35c-e25148ddc70e None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:42.716603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74395-bff6-4a70-a35c-e25148ddc70e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:42.716872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74395-bff6-4a70-a35c-e25148ddc70e None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:42.717508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74395-bff6-4a70-a35c-e25148ddc70e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:42.718925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74395-bff6-4a70-a35c-e25148ddc70e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:42.740840 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 565/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:06:42 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:44.903284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e77a3-b099-41d4-bceb-1486d5fcc9c3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:44.903831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e77a3-b099-41d4-bceb-1486d5fcc9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:44.903831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e77a3-b099-41d4-bceb-1486d5fcc9c3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:44.905166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 546/1111] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:44.910281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967a12-d6ba-4e51-962f-d2d1d45d331f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:44.910712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967a12-d6ba-4e51-962f-d2d1d45d331f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:44.910831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967a12-d6ba-4e51-962f-d2d1d45d331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:44.929929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-78967a12-d6ba-4e51-962f-d2d1d45d331f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:44.931137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-78967a12-d6ba-4e51-962f-d2d1d45d331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:44.940103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:44.997387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 566/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:45.267301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e77a3-b099-41d4-bceb-1486d5fcc9c3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:45.366488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e77a3-b099-41d4-bceb-1486d5fcc9c3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:45.399114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b5e5d-091d-4bad-ad6d-c40efc5efd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:45.399729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b5e5d-091d-4bad-ad6d-c40efc5efd0f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:45.400012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b5e5d-091d-4bad-ad6d-c40efc5efd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:45.400286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b5e5d-091d-4bad-ad6d-c40efc5efd0f None admin] PATH_INFO: `/v3/roles/377207058e944d2a91e7afd0f3c46025` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:45.401665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b5e5d-091d-4bad-ad6d-c40efc5efd0f None admin] RBAC: Authorizing `identity:get_role(role_id=377207058e944d2a91e7afd0f3c46025)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:45.403039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b5e5d-091d-4bad-ad6d-c40efc5efd0f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:45.404344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 547/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:45 2022] GET /identity/v3/roles/377207058e944d2a91e7afd0f3c46025 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:45.409997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967a12-d6ba-4e51-962f-d2d1d45d331f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:45.509510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967a12-d6ba-4e51-962f-d2d1d45d331f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:45.542404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8532102-d152-41c0-8973-0cbddf8f3b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:45.542969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8532102-d152-41c0-8973-0cbddf8f3b67 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:45.543278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8532102-d152-41c0-8973-0cbddf8f3b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:45.543549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8532102-d152-41c0-8973-0cbddf8f3b67 None admin] PATH_INFO: `/v3/users/ef7c227b661e4bafb7280cc81fca015e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:45.556316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8532102-d152-41c0-8973-0cbddf8f3b67 None admin] RBAC: Authorizing `identity:get_user(user_id=ef7c227b661e4bafb7280cc81fca015e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:45.557738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8532102-d152-41c0-8973-0cbddf8f3b67 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:45.559347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 567/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:45 2022] GET /identity/v3/users/ef7c227b661e4bafb7280cc81fca015e => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:45.565050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b5e5d-091d-4bad-ad6d-c40efc5efd0f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:45.576360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:45.663193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b5e5d-091d-4bad-ad6d-c40efc5efd0f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:45.695654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7819c-a761-4bd8-a04e-85601d4d970c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:45.696248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7819c-a761-4bd8-a04e-85601d4d970c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:45.696527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7819c-a761-4bd8-a04e-85601d4d970c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:45.696801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7819c-a761-4bd8-a04e-85601d4d970c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:45.761037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7819c-a761-4bd8-a04e-85601d4d970c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:45.762461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7819c-a761-4bd8-a04e-85601d4d970c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:45.772184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:45.857972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 548/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:06:45.863882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8532102-d152-41c0-8973-0cbddf8f3b67 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:45.866935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:45.963115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8532102-d152-41c0-8973-0cbddf8f3b67 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:45.996332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b45b0-a070-45ab-a0d0-c245c5951cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:45.996953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b45b0-a070-45ab-a0d0-c245c5951cdb None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:45.997237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b45b0-a070-45ab-a0d0-c245c5951cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:45.997515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b45b0-a070-45ab-a0d0-c245c5951cdb None admin] PATH_INFO: `/v3/projects/4cd11401139340c9a62398bd96c7ae8c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:45.998617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b45b0-a070-45ab-a0d0-c245c5951cdb None admin] RBAC: Authorizing `identity:get_project(project_id=4cd11401139340c9a62398bd96c7ae8c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:46.000079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b45b0-a070-45ab-a0d0-c245c5951cdb None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:46.001692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 568/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:06:45 2022] GET /identity/v3/projects/4cd11401139340c9a62398bd96c7ae8c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:46.007906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7819c-a761-4bd8-a04e-85601d4d970c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:46.105373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7819c-a761-4bd8-a04e-85601d4d970c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:46.114156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:46.137969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825057bb-7ab8-4832-8418-45011e78ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:46.138558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825057bb-7ab8-4832-8418-45011e78ad42 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:46.138833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825057bb-7ab8-4832-8418-45011e78ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:46.139128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825057bb-7ab8-4832-8418-45011e78ad42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:46.139837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825057bb-7ab8-4832-8418-45011e78ad42 None admin] RBAC: Adding query filter params (role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=4cd11401139340c9a62398bd96c7ae8c, user.id=ef7c227b661e4bafb7280cc81fca015e) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:46.140165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825057bb-7ab8-4832-8418-45011e78ad42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:46.141558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825057bb-7ab8-4832-8418-45011e78ad42 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:46.147497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 549/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:46 2022] GET /identity/v3/role_assignments?user.id=ef7c227b661e4bafb7280cc81fca015e&scope.project.id=4cd11401139340c9a62398bd96c7ae8c&role.id=377207058e944d2a91e7afd0f3c46025 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:48.254774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06804f8-5b8c-4d62-b414-21b2e001da16 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:48.255455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06804f8-5b8c-4d62-b414-21b2e001da16 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:48.255551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06804f8-5b8c-4d62-b414-21b2e001da16 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:48.256884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 569/1118] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:48.261918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68b77-8e5c-4729-b8ac-9692d4563ff4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:48.262304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68b77-8e5c-4729-b8ac-9692d4563ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:48.262458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c68b77-8e5c-4729-b8ac-9692d4563ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:48.280824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-14c68b77-8e5c-4729-b8ac-9692d4563ff4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:48.282028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-14c68b77-8e5c-4729-b8ac-9692d4563ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:48.347183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 550/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:48.620197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06804f8-5b8c-4d62-b414-21b2e001da16 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:48.689291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:48.720948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06804f8-5b8c-4d62-b414-21b2e001da16 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:48.754910 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed80af-b27e-4cd5-9d64-6f760ae575ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:48.755901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed80af-b27e-4cd5-9d64-6f760ae575ed None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:48.756229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed80af-b27e-4cd5-9d64-6f760ae575ed None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:48.756503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed80af-b27e-4cd5-9d64-6f760ae575ed None admin] PATH_INFO: `/v3/roles/377207058e944d2a91e7afd0f3c46025` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:48.757869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed80af-b27e-4cd5-9d64-6f760ae575ed None admin] RBAC: Authorizing `identity:get_role(role_id=377207058e944d2a91e7afd0f3c46025)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:48.759246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed80af-b27e-4cd5-9d64-6f760ae575ed None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:48.760542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 570/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:48 2022] GET /identity/v3/roles/377207058e944d2a91e7afd0f3c46025 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:48.766341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c68b77-8e5c-4729-b8ac-9692d4563ff4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:48.861664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c68b77-8e5c-4729-b8ac-9692d4563ff4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:48.863148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:48.895241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12356f52-cc08-4b69-bd11-4e7606f6506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:48.896331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356f52-cc08-4b69-bd11-4e7606f6506f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:48.896607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356f52-cc08-4b69-bd11-4e7606f6506f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:48.896883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356f52-cc08-4b69-bd11-4e7606f6506f None admin] PATH_INFO: `/v3/users/ef7c227b661e4bafb7280cc81fca015e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:48.897993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12356f52-cc08-4b69-bd11-4e7606f6506f None admin] RBAC: Authorizing `identity:get_user(user_id=ef7c227b661e4bafb7280cc81fca015e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:48.899443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12356f52-cc08-4b69-bd11-4e7606f6506f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:48.901163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 551/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:48 2022] GET /identity/v3/users/ef7c227b661e4bafb7280cc81fca015e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:48.906865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed80af-b27e-4cd5-9d64-6f760ae575ed None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:49.003624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed80af-b27e-4cd5-9d64-6f760ae575ed None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:49.036940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565ffb6-3d6a-4a89-984f-be2ffea483d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:49.037559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ffb6-3d6a-4a89-984f-be2ffea483d7 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:49.037835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ffb6-3d6a-4a89-984f-be2ffea483d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:49.038105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565ffb6-3d6a-4a89-984f-be2ffea483d7 None admin] PATH_INFO: `/v3/projects/4cd11401139340c9a62398bd96c7ae8c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:49.039232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565ffb6-3d6a-4a89-984f-be2ffea483d7 None admin] RBAC: Authorizing `identity:get_project(project_id=4cd11401139340c9a62398bd96c7ae8c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:49.040636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565ffb6-3d6a-4a89-984f-be2ffea483d7 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:49.042222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 571/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:06:48 2022] GET /identity/v3/projects/4cd11401139340c9a62398bd96c7ae8c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:49.048087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12356f52-cc08-4b69-bd11-4e7606f6506f None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:49.143401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12356f52-cc08-4b69-bd11-4e7606f6506f None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:49.177549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd176024-3f35-48e1-82d1-ed018ba79ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:49.178185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd176024-3f35-48e1-82d1-ed018ba79ff6 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:49.178469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd176024-3f35-48e1-82d1-ed018ba79ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:49.178750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd176024-3f35-48e1-82d1-ed018ba79ff6 None admin] PATH_INFO: `/v3/projects/4cd11401139340c9a62398bd96c7ae8c/users/ef7c227b661e4bafb7280cc81fca015e/roles/377207058e944d2a91e7afd0f3c46025` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:49.180912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd176024-3f35-48e1-82d1-ed018ba79ff6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cd11401139340c9a62398bd96c7ae8c, user_id=ef7c227b661e4bafb7280cc81fca015e, role_id=377207058e944d2a91e7afd0f3c46025)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:49.182332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd176024-3f35-48e1-82d1-ed018ba79ff6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:49.195109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 552/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:06:49 2022] PUT /identity/v3/projects/4cd11401139340c9a62398bd96c7ae8c/users/ef7c227b661e4bafb7280cc81fca015e/roles/377207058e944d2a91e7afd0f3c46025 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:06:51.302882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9664-28f1-4f35-9b88-977a531cd53e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:51.303489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9664-28f1-4f35-9b88-977a531cd53e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:51.303489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c9664-28f1-4f35-9b88-977a531cd53e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:51.304802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 572/1124] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:51.310027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1afe3-8a99-42e2-a3d6-2875a7b1c3db None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:51.310455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1afe3-8a99-42e2-a3d6-2875a7b1c3db None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:51.310560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1afe3-8a99-42e2-a3d6-2875a7b1c3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:51.329136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ada1afe3-8a99-42e2-a3d6-2875a7b1c3db None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:51.330322 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ada1afe3-8a99-42e2-a3d6-2875a7b1c3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:51.353629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:51.396743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 553/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:51.666846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c9664-28f1-4f35-9b88-977a531cd53e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:51.675706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:51.766970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c9664-28f1-4f35-9b88-977a531cd53e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:51.801081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64500-b072-48d3-a782-da402c4be53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:51.801700 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64500-b072-48d3-a782-da402c4be53a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:51.802146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64500-b072-48d3-a782-da402c4be53a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:51.802434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe64500-b072-48d3-a782-da402c4be53a None admin] PATH_INFO: `/v3/roles/377207058e944d2a91e7afd0f3c46025` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:51.803835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe64500-b072-48d3-a782-da402c4be53a None admin] RBAC: Authorizing `identity:get_role(role_id=377207058e944d2a91e7afd0f3c46025)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:51.805197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe64500-b072-48d3-a782-da402c4be53a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:51.806501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 573/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:51 2022] GET /identity/v3/roles/377207058e944d2a91e7afd0f3c46025 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:51.812274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1afe3-8a99-42e2-a3d6-2875a7b1c3db None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:51.908840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1afe3-8a99-42e2-a3d6-2875a7b1c3db None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:51.941774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc00c1-03a2-45c9-8fdd-4afd60319e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:51.942341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc00c1-03a2-45c9-8fdd-4afd60319e74 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:51.942647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc00c1-03a2-45c9-8fdd-4afd60319e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:51.942930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc00c1-03a2-45c9-8fdd-4afd60319e74 None admin] PATH_INFO: `/v3/users/ef7c227b661e4bafb7280cc81fca015e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:51.944080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc00c1-03a2-45c9-8fdd-4afd60319e74 None admin] RBAC: Authorizing `identity:get_user(user_id=ef7c227b661e4bafb7280cc81fca015e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:51.945500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc00c1-03a2-45c9-8fdd-4afd60319e74 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:51.947078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 554/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:06:51 2022] GET /identity/v3/users/ef7c227b661e4bafb7280cc81fca015e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:51.952620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64500-b072-48d3-a782-da402c4be53a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:52.026042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:52.051522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe64500-b072-48d3-a782-da402c4be53a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:52.085771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4039e-bfd9-45ec-b74c-8389d767e612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:52.086373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4039e-bfd9-45ec-b74c-8389d767e612 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:52.086654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4039e-bfd9-45ec-b74c-8389d767e612 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:52.086927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e4039e-bfd9-45ec-b74c-8389d767e612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:52.152772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4039e-bfd9-45ec-b74c-8389d767e612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:52.154209 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e4039e-bfd9-45ec-b74c-8389d767e612 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:52.225089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:52.250384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 574/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:06:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:06:52.257067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc00c1-03a2-45c9-8fdd-4afd60319e74 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:52.284906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:52.355178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc00c1-03a2-45c9-8fdd-4afd60319e74 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:52.387466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1af30-ec95-4fa1-87e7-bbe65970af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:52.388074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1af30-ec95-4fa1-87e7-bbe65970af40 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:52.388352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1af30-ec95-4fa1-87e7-bbe65970af40 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:52.388626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1af30-ec95-4fa1-87e7-bbe65970af40 None admin] PATH_INFO: `/v3/projects/4cd11401139340c9a62398bd96c7ae8c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:52.389713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1af30-ec95-4fa1-87e7-bbe65970af40 None admin] RBAC: Authorizing `identity:get_project(project_id=4cd11401139340c9a62398bd96c7ae8c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:52.391143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1af30-ec95-4fa1-87e7-bbe65970af40 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:52.392731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 555/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:06:52 2022] GET /identity/v3/projects/4cd11401139340c9a62398bd96c7ae8c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:52.399704 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4039e-bfd9-45ec-b74c-8389d767e612 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:52.496877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e4039e-bfd9-45ec-b74c-8389d767e612 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:52.530400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ac09-a8b5-4e96-98bb-677701da02cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:52.531020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ac09-a8b5-4e96-98bb-677701da02cf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:52.531306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ac09-a8b5-4e96-98bb-677701da02cf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:52.531582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ac09-a8b5-4e96-98bb-677701da02cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:52.532294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ac09-a8b5-4e96-98bb-677701da02cf None admin] RBAC: Adding query filter params (role.id=377207058e944d2a91e7afd0f3c46025, scope.project.id=4cd11401139340c9a62398bd96c7ae8c, user.id=ef7c227b661e4bafb7280cc81fca015e) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:06:52.532608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ac09-a8b5-4e96-98bb-677701da02cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:52.534026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ac09-a8b5-4e96-98bb-677701da02cf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:52.539827 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 575/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:06:52 2022] GET /identity/v3/role_assignments?user.id=ef7c227b661e4bafb7280cc81fca015e&scope.project.id=4cd11401139340c9a62398bd96c7ae8c&role.id=377207058e944d2a91e7afd0f3c46025 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:54.679835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a1e3-812c-44b5-af61-c84640a82b1d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:54.680379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a1e3-812c-44b5-af61-c84640a82b1d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:54.680379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386a1e3-812c-44b5-af61-c84640a82b1d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:54.681697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 556/1131] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:54.686836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215028dd-f0cd-4654-84e7-683b069ef4d1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:54.687243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215028dd-f0cd-4654-84e7-683b069ef4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:54.687420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215028dd-f0cd-4654-84e7-683b069ef4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:54.705735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-215028dd-f0cd-4654-84e7-683b069ef4d1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:54.706898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-215028dd-f0cd-4654-84e7-683b069ef4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:54.735827 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:54.773216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 576/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:55.036267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386a1e3-812c-44b5-af61-c84640a82b1d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:55.127980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:55.135922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386a1e3-812c-44b5-af61-c84640a82b1d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:55.168838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1bc33-c78f-44bb-b33d-4d72ee92fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:55.169548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1bc33-c78f-44bb-b33d-4d72ee92fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:55.170015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1bc33-c78f-44bb-b33d-4d72ee92fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:55.170486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1bc33-c78f-44bb-b33d-4d72ee92fbe8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:55.172396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1bc33-c78f-44bb-b33d-4d72ee92fbe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:55.175329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1bc33-c78f-44bb-b33d-4d72ee92fbe8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:55.178847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 557/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:06:55.184845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215028dd-f0cd-4654-84e7-683b069ef4d1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:55.282036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215028dd-f0cd-4654-84e7-683b069ef4d1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:55.316044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f47e8-7602-4a79-ad43-4041c5129be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:55.316583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f47e8-7602-4a79-ad43-4041c5129be0 None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:55.316866 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f47e8-7602-4a79-ad43-4041c5129be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:55.317145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f47e8-7602-4a79-ad43-4041c5129be0 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:55.317826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f47e8-7602-4a79-ad43-4041c5129be0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:55.319282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f47e8-7602-4a79-ad43-4041c5129be0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:55.345412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 577/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:06:55 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:06:57.515255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80df1c-5e75-47d5-a368-fe3b723615f2 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:57.515736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80df1c-5e75-47d5-a368-fe3b723615f2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:57.515859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80df1c-5e75-47d5-a368-fe3b723615f2 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:57.517168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 558/1135] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:06:57.522911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9bfb-c49f-4773-ab43-542f7ec09284 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:57.523336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9bfb-c49f-4773-ab43-542f7ec09284 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:57.523523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9bfb-c49f-4773-ab43-542f7ec09284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:57.541409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-97ac9bfb-c49f-4773-ab43-542f7ec09284 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:06:57.542596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-97ac9bfb-c49f-4773-ab43-542f7ec09284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:06:57.556266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:06:57.608867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 578/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:06:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:06:57.878548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80df1c-5e75-47d5-a368-fe3b723615f2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:57.977907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80df1c-5e75-47d5-a368-fe3b723615f2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:58.010394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67055175-7356-4e09-86d4-db4164d4bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:58.011028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67055175-7356-4e09-86d4-db4164d4bb45 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:58.011315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67055175-7356-4e09-86d4-db4164d4bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:58.011590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67055175-7356-4e09-86d4-db4164d4bb45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:58.012682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67055175-7356-4e09-86d4-db4164d4bb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:58.014103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67055175-7356-4e09-86d4-db4164d4bb45 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:58.015677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 559/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:06:58.021851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac9bfb-c49f-4773-ab43-542f7ec09284 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:06:58.120700 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac9bfb-c49f-4773-ab43-542f7ec09284 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:06:58.153781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12476421-5979-4c05-9ccd-790e6417ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:06:58.154388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12476421-5979-4c05-9ccd-790e6417ca0d None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:06:58.154667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12476421-5979-4c05-9ccd-790e6417ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:06:58.154935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12476421-5979-4c05-9ccd-790e6417ca0d None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:06:58.155608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12476421-5979-4c05-9ccd-790e6417ca0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:06:58.157027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12476421-5979-4c05-9ccd-790e6417ca0d None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:06:58.178318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 579/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:06:58 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:07:00.345838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01a10-9441-4d80-b58f-b7ddb1f2f888 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:00.346360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01a10-9441-4d80-b58f-b7ddb1f2f888 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:00.346360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c01a10-9441-4d80-b58f-b7ddb1f2f888 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:00.347735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 560/1139] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:00.353546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0cec-f99e-4d01-b1ff-4410119c0ab1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:00.353931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0cec-f99e-4d01-b1ff-4410119c0ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:00.354099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0cec-f99e-4d01-b1ff-4410119c0ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:00.367491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:00.373102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cccb0cec-f99e-4d01-b1ff-4410119c0ab1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:00.374544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cccb0cec-f99e-4d01-b1ff-4410119c0ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:00.441079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 580/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:07:00.713425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c01a10-9441-4d80-b58f-b7ddb1f2f888 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:00.745194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:00.813606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c01a10-9441-4d80-b58f-b7ddb1f2f888 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:00.846107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1afed0-076b-44a1-b2ae-1cceda09066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:00.846723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afed0-076b-44a1-b2ae-1cceda09066c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:00.847019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afed0-076b-44a1-b2ae-1cceda09066c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:00.847300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1afed0-076b-44a1-b2ae-1cceda09066c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:00.857929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1afed0-076b-44a1-b2ae-1cceda09066c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ed1afed0-076b-44a1-b2ae-1cceda09066c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:07:00.862698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:07:00.863909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:07:00.864827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 561/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:07:00.870073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb0cec-f99e-4d01-b1ff-4410119c0ab1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:00.965780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb0cec-f99e-4d01-b1ff-4410119c0ab1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:00.998955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:00.999576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:00.999857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:01.000128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:01.000779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:01.001082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:01.002439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:01.004601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:01.011256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 581/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:01.017237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1afed0-076b-44a1-b2ae-1cceda09066c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:01.107197 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:01.115941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1afed0-076b-44a1-b2ae-1cceda09066c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:01.148693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedd311-5ffb-4741-94b5-26ed1706ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:01.149310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedd311-5ffb-4741-94b5-26ed1706ef3d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:01.149592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedd311-5ffb-4741-94b5-26ed1706ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:01.149870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedd311-5ffb-4741-94b5-26ed1706ef3d None admin] PATH_INFO: `/v3/users/5ee15cbecf8a40f4b8ab60cf3df22729` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:01.163097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedd311-5ffb-4741-94b5-26ed1706ef3d None admin] RBAC: Authorizing `identity:get_user(user_id=5ee15cbecf8a40f4b8ab60cf3df22729)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:01.164522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedd311-5ffb-4741-94b5-26ed1706ef3d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:01.166108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 562/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:07:01 2022] GET /identity/v3/users/5ee15cbecf8a40f4b8ab60cf3df22729 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:01.171800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:01.276215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2be54d-476d-456c-bb6d-b85f21ba80d0 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:01.308626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf15004-89a3-4890-9d72-91bd4e77c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:01.309224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15004-89a3-4890-9d72-91bd4e77c82a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:01.309502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15004-89a3-4890-9d72-91bd4e77c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:01.309775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf15004-89a3-4890-9d72-91bd4e77c82a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:01.373015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:01.376860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf15004-89a3-4890-9d72-91bd4e77c82a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:01.378294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf15004-89a3-4890-9d72-91bd4e77c82a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:01.473016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 582/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:07:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:07:01.479712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedd311-5ffb-4741-94b5-26ed1706ef3d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:01.577123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedd311-5ffb-4741-94b5-26ed1706ef3d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:01.610047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d346b3-a561-4a9c-81e2-dd2a7451c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:01.610657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d346b3-a561-4a9c-81e2-dd2a7451c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:01.610932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d346b3-a561-4a9c-81e2-dd2a7451c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:01.611231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d346b3-a561-4a9c-81e2-dd2a7451c4c5 None admin] PATH_INFO: `/v3/projects/8dea41236b374a2a9165dea551e7d92e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:01.612312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d346b3-a561-4a9c-81e2-dd2a7451c4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=8dea41236b374a2a9165dea551e7d92e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:01.613717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d346b3-a561-4a9c-81e2-dd2a7451c4c5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:01.615369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 563/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:07:01 2022] GET /identity/v3/projects/8dea41236b374a2a9165dea551e7d92e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:01.621315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf15004-89a3-4890-9d72-91bd4e77c82a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:01.714028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:01.717996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf15004-89a3-4890-9d72-91bd4e77c82a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:01.753284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c082e-8d15-4a03-83bf-ade02ac4f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:01.753880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c082e-8d15-4a03-83bf-ade02ac4f19f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:01.754159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c082e-8d15-4a03-83bf-ade02ac4f19f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:01.754465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c082e-8d15-4a03-83bf-ade02ac4f19f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:01.755284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c082e-8d15-4a03-83bf-ade02ac4f19f None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=8dea41236b374a2a9165dea551e7d92e, user.id=5ee15cbecf8a40f4b8ab60cf3df22729) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:01.755599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c082e-8d15-4a03-83bf-ade02ac4f19f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:01.757014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c082e-8d15-4a03-83bf-ade02ac4f19f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:01.762231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 583/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:07:01 2022] GET /identity/v3/role_assignments?user.id=5ee15cbecf8a40f4b8ab60cf3df22729&scope.project.id=8dea41236b374a2a9165dea551e7d92e&role.id=0f99070a6a88400199520fccd98977b6 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:03.850823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f5071-19b5-4965-be3a-5813f1e3f011 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:03.851416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f5071-19b5-4965-be3a-5813f1e3f011 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:03.851416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f5071-19b5-4965-be3a-5813f1e3f011 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:03.852715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 564/1147] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:03.857747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e17aa-5832-477f-9280-8fabb9db1d66 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:03.858125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e17aa-5832-477f-9280-8fabb9db1d66 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:03.858299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e17aa-5832-477f-9280-8fabb9db1d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:03.876637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e57e17aa-5832-477f-9280-8fabb9db1d66 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:03.877824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e57e17aa-5832-477f-9280-8fabb9db1d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:03.941730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 584/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:07:04.209843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f5071-19b5-4965-be3a-5813f1e3f011 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:04.228846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:04.308405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f5071-19b5-4965-be3a-5813f1e3f011 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:04.340986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b95ba-0a61-463b-94b6-857b0c4483bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:04.341595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b95ba-0a61-463b-94b6-857b0c4483bc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:04.341872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b95ba-0a61-463b-94b6-857b0c4483bc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:04.342141 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b95ba-0a61-463b-94b6-857b0c4483bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:04.352874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b95ba-0a61-463b-94b6-857b0c4483bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-c25b95ba-0a61-463b-94b6-857b0c4483bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:07:04.357519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:07:04.358604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:07:04.359664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 565/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:07:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:07:04.365268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e17aa-5832-477f-9280-8fabb9db1d66 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:04.452719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:04.461765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e17aa-5832-477f-9280-8fabb9db1d66 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:04.495507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:04.496109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:04.496389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:04.496664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:04.497321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:04.497625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:04.498981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:04.506836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 585/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:04.512656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b95ba-0a61-463b-94b6-857b0c4483bc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:04.589352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:04.610195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b95ba-0a61-463b-94b6-857b0c4483bc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:04.643189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea3024-e467-4a03-8887-11419b26b46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:04.643801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea3024-e467-4a03-8887-11419b26b46b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:04.644081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea3024-e467-4a03-8887-11419b26b46b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:04.644356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea3024-e467-4a03-8887-11419b26b46b None admin] PATH_INFO: `/v3/users/5ee15cbecf8a40f4b8ab60cf3df22729` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:04.645457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea3024-e467-4a03-8887-11419b26b46b None admin] RBAC: Authorizing `identity:get_user(user_id=5ee15cbecf8a40f4b8ab60cf3df22729)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:04.646862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea3024-e467-4a03-8887-11419b26b46b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:04.648447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 566/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:07:04 2022] GET /identity/v3/users/5ee15cbecf8a40f4b8ab60cf3df22729 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:04.654045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:04.751951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c25c0b-fb09-4b91-befe-319907b6645a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:04.786697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2fa4-846f-4d02-8cbe-589efb16f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:04.787333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2fa4-846f-4d02-8cbe-589efb16f97e None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:04.787619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2fa4-846f-4d02-8cbe-589efb16f97e None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:04.787892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2fa4-846f-4d02-8cbe-589efb16f97e None admin] PATH_INFO: `/v3/projects/8dea41236b374a2a9165dea551e7d92e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:04.788986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2fa4-846f-4d02-8cbe-589efb16f97e None admin] RBAC: Authorizing `identity:get_project(project_id=8dea41236b374a2a9165dea551e7d92e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:04.790399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d2fa4-846f-4d02-8cbe-589efb16f97e None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:04.792035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 586/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:07:04 2022] GET /identity/v3/projects/8dea41236b374a2a9165dea551e7d92e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:04.797869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea3024-e467-4a03-8887-11419b26b46b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:04.894010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea3024-e467-4a03-8887-11419b26b46b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:04.926892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cdd51-119e-4e25-8937-1795cacc584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:04.927624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cdd51-119e-4e25-8937-1795cacc584c None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:04.927905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cdd51-119e-4e25-8937-1795cacc584c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:04.928187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cdd51-119e-4e25-8937-1795cacc584c None admin] PATH_INFO: `/v3/projects/8dea41236b374a2a9165dea551e7d92e/users/5ee15cbecf8a40f4b8ab60cf3df22729/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:04.930059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cdd51-119e-4e25-8937-1795cacc584c None admin] RBAC: Authorizing `identity:create_grant(project_id=8dea41236b374a2a9165dea551e7d92e, user_id=5ee15cbecf8a40f4b8ab60cf3df22729, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:04.931510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cdd51-119e-4e25-8937-1795cacc584c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:04.944361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 567/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:07:04 2022] PUT /identity/v3/projects/8dea41236b374a2a9165dea551e7d92e/users/5ee15cbecf8a40f4b8ab60cf3df22729/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:07:07.086414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c1502-2310-49b2-a3df-0b809509af24 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:07.086938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c1502-2310-49b2-a3df-0b809509af24 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:07.086938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c1502-2310-49b2-a3df-0b809509af24 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:07.088344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 587/1154] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:07.093598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb3486-f0e1-47bd-8eee-93acb900fc3a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:07.094020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb3486-f0e1-47bd-8eee-93acb900fc3a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:07.094154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb3486-f0e1-47bd-8eee-93acb900fc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:07.107174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:07.112877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1bdb3486-f0e1-47bd-8eee-93acb900fc3a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:07.114848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1bdb3486-f0e1-47bd-8eee-93acb900fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:07.179969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 568/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:07:07.458757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c1502-2310-49b2-a3df-0b809509af24 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:07.484584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:07.561141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c1502-2310-49b2-a3df-0b809509af24 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:07.593747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec77a9a-914b-4543-8947-3bb163e1185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:07.594359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77a9a-914b-4543-8947-3bb163e1185d None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:07.594635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77a9a-914b-4543-8947-3bb163e1185d None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:07.594908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77a9a-914b-4543-8947-3bb163e1185d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:07.605513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec77a9a-914b-4543-8947-3bb163e1185d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-dec77a9a-914b-4543-8947-3bb163e1185d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:07:07.610243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:07:07.615162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:07:07.616301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 588/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:07:07.617970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb3486-f0e1-47bd-8eee-93acb900fc3a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:07.714047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb3486-f0e1-47bd-8eee-93acb900fc3a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:07.748104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:07.748698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:07.748980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:07.749258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:07.749919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:07.750225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:07.751612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:07.753719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:07.761093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 569/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:07.767027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec77a9a-914b-4543-8947-3bb163e1185d None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:07.846141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:07.865073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec77a9a-914b-4543-8947-3bb163e1185d None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:07.897821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76d4b-8a62-4e0e-9056-0190499edcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:07.898437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76d4b-8a62-4e0e-9056-0190499edcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:07.898716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76d4b-8a62-4e0e-9056-0190499edcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:07.899015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f76d4b-8a62-4e0e-9056-0190499edcb8 None admin] PATH_INFO: `/v3/users/5ee15cbecf8a40f4b8ab60cf3df22729` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:07.900104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f76d4b-8a62-4e0e-9056-0190499edcb8 None admin] RBAC: Authorizing `identity:get_user(user_id=5ee15cbecf8a40f4b8ab60cf3df22729)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:07.901522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f76d4b-8a62-4e0e-9056-0190499edcb8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:07.903084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 589/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:07:07 2022] GET /identity/v3/users/5ee15cbecf8a40f4b8ab60cf3df22729 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:07.908795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:08.007326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485e19c-8b95-4013-b422-2c76fec127d2 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:08.039440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73193051-c1d9-48c9-92e3-aa11504e0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:08.040029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193051-c1d9-48c9-92e3-aa11504e0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:08.040313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193051-c1d9-48c9-92e3-aa11504e0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:08.040592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73193051-c1d9-48c9-92e3-aa11504e0ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:08.102676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:08.106491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73193051-c1d9-48c9-92e3-aa11504e0ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:08.107945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73193051-c1d9-48c9-92e3-aa11504e0ff6 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:08.202417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 570/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:07:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:07:08.208574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76d4b-8a62-4e0e-9056-0190499edcb8 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:08.307909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f76d4b-8a62-4e0e-9056-0190499edcb8 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:08.340287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979e359-6f6c-427c-a987-27c3941a57c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:08.340898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979e359-6f6c-427c-a987-27c3941a57c8 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:08.341174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979e359-6f6c-427c-a987-27c3941a57c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:08.341446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979e359-6f6c-427c-a987-27c3941a57c8 None admin] PATH_INFO: `/v3/projects/8dea41236b374a2a9165dea551e7d92e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:08.342535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979e359-6f6c-427c-a987-27c3941a57c8 None admin] RBAC: Authorizing `identity:get_project(project_id=8dea41236b374a2a9165dea551e7d92e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:08.343976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979e359-6f6c-427c-a987-27c3941a57c8 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:08.345574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 590/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:07:08 2022] GET /identity/v3/projects/8dea41236b374a2a9165dea551e7d92e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:08.352508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73193051-c1d9-48c9-92e3-aa11504e0ff6 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:08.446928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:08.450753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73193051-c1d9-48c9-92e3-aa11504e0ff6 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:08.485620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926bb41-e4f2-4f1e-a28f-cf2d21fe267b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:08.486219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926bb41-e4f2-4f1e-a28f-cf2d21fe267b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:08.486501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926bb41-e4f2-4f1e-a28f-cf2d21fe267b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:08.486778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926bb41-e4f2-4f1e-a28f-cf2d21fe267b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:08.487533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926bb41-e4f2-4f1e-a28f-cf2d21fe267b None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=8dea41236b374a2a9165dea551e7d92e, user.id=5ee15cbecf8a40f4b8ab60cf3df22729) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:08.487844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926bb41-e4f2-4f1e-a28f-cf2d21fe267b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:08.489469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926bb41-e4f2-4f1e-a28f-cf2d21fe267b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:08.495196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 571/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:07:08 2022] GET /identity/v3/role_assignments?user.id=5ee15cbecf8a40f4b8ab60cf3df22729&scope.project.id=8dea41236b374a2a9165dea551e7d92e&role.id=0f99070a6a88400199520fccd98977b6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:10.654767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698ff1-e010-4896-8b22-946501959568 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:10.655337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698ff1-e010-4896-8b22-946501959568 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:10.655337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e698ff1-e010-4896-8b22-946501959568 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:10.656704 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 591/1162] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:10.662440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b941c-df2b-414b-8820-2c27e890a5dc None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:10.662869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b941c-df2b-414b-8820-2c27e890a5dc None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:10.663026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b941c-df2b-414b-8820-2c27e890a5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:10.681036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-299b941c-df2b-414b-8820-2c27e890a5dc None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:10.682208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-299b941c-df2b-414b-8820-2c27e890a5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:10.746191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 572/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:07:11.009577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e698ff1-e010-4896-8b22-946501959568 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:11.029309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:11.111306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e698ff1-e010-4896-8b22-946501959568 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:11.144103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f588-f529-4aa5-bc1e-aa76ccf607cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:11.145235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f588-f529-4aa5-bc1e-aa76ccf607cd None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:11.145515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f588-f529-4aa5-bc1e-aa76ccf607cd None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:11.145801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f588-f529-4aa5-bc1e-aa76ccf607cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:11.210464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f588-f529-4aa5-bc1e-aa76ccf607cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:11.211924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f588-f529-4aa5-bc1e-aa76ccf607cd None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:11.228874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:11.319310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 592/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:07:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:07:11.325112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b941c-df2b-414b-8820-2c27e890a5dc None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:11.412584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:11.421526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b941c-df2b-414b-8820-2c27e890a5dc None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:11.453983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ca1df-4020-4fbf-961c-2381a1511ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:11.454607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca1df-4020-4fbf-961c-2381a1511ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:11.454884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca1df-4020-4fbf-961c-2381a1511ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:11.455192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca1df-4020-4fbf-961c-2381a1511ca4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:11.462313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ca1df-4020-4fbf-961c-2381a1511ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:11.463765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ca1df-4020-4fbf-961c-2381a1511ca4 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-410ca1df-4020-4fbf-961c-2381a1511ca4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:07:11.476269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:07:11.477502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:07:11.478543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 573/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:07:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:07:11.483343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f588-f529-4aa5-bc1e-aa76ccf607cd None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:11.579452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f588-f529-4aa5-bc1e-aa76ccf607cd None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:11.596426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:11.614134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fe4f3-16c6-4237-97f5-e3d2d31bc438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:11.614728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe4f3-16c6-4237-97f5-e3d2d31bc438 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:11.615032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe4f3-16c6-4237-97f5-e3d2d31bc438 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:11.615311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fe4f3-16c6-4237-97f5-e3d2d31bc438 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:11.615942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe4f3-16c6-4237-97f5-e3d2d31bc438 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:11.616247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe4f3-16c6-4237-97f5-e3d2d31bc438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:11.617604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fe4f3-16c6-4237-97f5-e3d2d31bc438 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:11.624581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 593/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Fri Sep 16 19:07:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:13.714599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323847-8c24-45c3-bfb8-590d2159d306 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:13.715159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323847-8c24-45c3-bfb8-590d2159d306 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:13.715159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33323847-8c24-45c3-bfb8-590d2159d306 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:13.716495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 574/1167] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:13.721594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5e58-6681-4106-8d61-d1af6197fc3a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:13.721976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5e58-6681-4106-8d61-d1af6197fc3a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:13.722145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f5e58-6681-4106-8d61-d1af6197fc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:13.740566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-092f5e58-6681-4106-8d61-d1af6197fc3a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:13.741772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-092f5e58-6681-4106-8d61-d1af6197fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:13.806505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 594/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:07:14.070331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33323847-8c24-45c3-bfb8-590d2159d306 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:14.171611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33323847-8c24-45c3-bfb8-590d2159d306 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:14.206204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1233b-e987-4265-9719-f40c29f8a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:14.207688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1233b-e987-4265-9719-f40c29f8a438 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:14.208104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1233b-e987-4265-9719-f40c29f8a438 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:14.208506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1233b-e987-4265-9719-f40c29f8a438 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:14.209459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1233b-e987-4265-9719-f40c29f8a438 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:14.211511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1233b-e987-4265-9719-f40c29f8a438 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:14.227554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 575/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Fri Sep 16 19:07:14 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:07:16.367588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6350-8b3d-4be9-adbc-140bab040729 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:16.368159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6350-8b3d-4be9-adbc-140bab040729 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:16.368159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6350-8b3d-4be9-adbc-140bab040729 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:16.369474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 595/1170] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:16.374575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c056f-21e0-4c52-826d-a62cc0b1b47b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:16.375023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c056f-21e0-4c52-826d-a62cc0b1b47b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:16.375142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c056f-21e0-4c52-826d-a62cc0b1b47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:16.393398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-992c056f-21e0-4c52-826d-a62cc0b1b47b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:16.395439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-992c056f-21e0-4c52-826d-a62cc0b1b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:16.402612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:16.461881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 576/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 19:07:16.731070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae6350-8b3d-4be9-adbc-140bab040729 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:16.829931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae6350-8b3d-4be9-adbc-140bab040729 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:16.843662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:16.864872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a264e4f-7b89-42a7-8b22-5db05d13d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:16.865488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264e4f-7b89-42a7-8b22-5db05d13d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:16.865765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264e4f-7b89-42a7-8b22-5db05d13d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:16.866037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a264e4f-7b89-42a7-8b22-5db05d13d1f4 None admin] PATH_INFO: `/v3/domains/43c073c309264db487896c9cc57f4d6b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:16.875965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264e4f-7b89-42a7-8b22-5db05d13d1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=43c073c309264db487896c9cc57f4d6b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:16.877384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a264e4f-7b89-42a7-8b22-5db05d13d1f4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:16.879063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 596/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Sep 16 19:07:16 2022] GET /identity/v3/domains/43c073c309264db487896c9cc57f4d6b => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:16.884720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c056f-21e0-4c52-826d-a62cc0b1b47b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:16.980638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c056f-21e0-4c52-826d-a62cc0b1b47b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:17.013219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf26e41-1d83-4a88-8f70-f818b1b5d65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:17.013759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf26e41-1d83-4a88-8f70-f818b1b5d65b None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:17.014038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf26e41-1d83-4a88-8f70-f818b1b5d65b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:17.014309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf26e41-1d83-4a88-8f70-f818b1b5d65b None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:17.014951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf26e41-1d83-4a88-8f70-f818b1b5d65b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:17.016396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf26e41-1d83-4a88-8f70-f818b1b5d65b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:17.030291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:17.042211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 577/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:07:16 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:07:19.198707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6ca1-48d4-47d4-af5d-7348ef5da45a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:19.199292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6ca1-48d4-47d4-af5d-7348ef5da45a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:19.199292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa6ca1-48d4-47d4-af5d-7348ef5da45a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:19.200642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 597/1174] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:19.206016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828838-3905-4907-9a40-0878b638ed34 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:19.206419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828838-3905-4907-9a40-0878b638ed34 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:19.207207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c828838-3905-4907-9a40-0878b638ed34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:19.224894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7c828838-3905-4907-9a40-0878b638ed34 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:19.226335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7c828838-3905-4907-9a40-0878b638ed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:19.290403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 578/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:07:19.560957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa6ca1-48d4-47d4-af5d-7348ef5da45a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:19.661445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa6ca1-48d4-47d4-af5d-7348ef5da45a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:19.694945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03090d-7465-45dd-9854-a30d540cad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:19.695581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03090d-7465-45dd-9854-a30d540cad55 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:19.695859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03090d-7465-45dd-9854-a30d540cad55 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:19.696131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03090d-7465-45dd-9854-a30d540cad55 None admin] PATH_INFO: `/v3/domains/43c073c309264db487896c9cc57f4d6b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:19.697225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03090d-7465-45dd-9854-a30d540cad55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=43c073c309264db487896c9cc57f4d6b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:19.698639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03090d-7465-45dd-9854-a30d540cad55 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:19.700203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 598/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Fri Sep 16 19:07:19 2022] GET /identity/v3/domains/43c073c309264db487896c9cc57f4d6b => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:19.705825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c828838-3905-4907-9a40-0878b638ed34 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:19.799982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c828838-3905-4907-9a40-0878b638ed34 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:19.823215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:19.834279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15acd24-b9f2-4640-84ee-014ed4209d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:19.834880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15acd24-b9f2-4640-84ee-014ed4209d64 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:19.835187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15acd24-b9f2-4640-84ee-014ed4209d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:19.835460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15acd24-b9f2-4640-84ee-014ed4209d64 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:19.836092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15acd24-b9f2-4640-84ee-014ed4209d64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:19.837513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15acd24-b9f2-4640-84ee-014ed4209d64 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:19.857456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 579/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:07:19 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:07:22.037786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056386-eda1-48fa-a585-93932d345b07 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:22.038312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056386-eda1-48fa-a585-93932d345b07 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:22.038312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056386-eda1-48fa-a585-93932d345b07 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:22.039719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 599/1178] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:22.045039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b08b-db05-4ee0-9f20-74742dfe62ab None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:22.045454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b08b-db05-4ee0-9f20-74742dfe62ab None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:22.045595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b08b-db05-4ee0-9f20-74742dfe62ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:22.065230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8e82b08b-db05-4ee0-9f20-74742dfe62ab None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:22.067163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8e82b08b-db05-4ee0-9f20-74742dfe62ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:22.131375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 580/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:07:22.398604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056386-eda1-48fa-a585-93932d345b07 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:22.442447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:22.500186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056386-eda1-48fa-a585-93932d345b07 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:22.533366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6d744-5a83-4839-abd7-57215aee180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:22.533986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d744-5a83-4839-abd7-57215aee180f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:22.534266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d744-5a83-4839-abd7-57215aee180f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:22.534568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d744-5a83-4839-abd7-57215aee180f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:22.544928 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6d744-5a83-4839-abd7-57215aee180f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-cea6d744-5a83-4839-abd7-57215aee180f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:07:22.549637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:07:22.551460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:07:22.552338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 600/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:07:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:07:22.557218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82b08b-db05-4ee0-9f20-74742dfe62ab None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:22.653699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82b08b-db05-4ee0-9f20-74742dfe62ab None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:22.664073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:22.687660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:22.688255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:22.688531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:22.688804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:22.689453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:22.689751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:22.691939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:22.699614 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 581/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:07:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:22.705557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6d744-5a83-4839-abd7-57215aee180f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:22.800696 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:22.803699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6d744-5a83-4839-abd7-57215aee180f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:22.836994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63551789-9921-4d1a-89af-fc44f7395ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:22.837611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63551789-9921-4d1a-89af-fc44f7395ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:22.837892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63551789-9921-4d1a-89af-fc44f7395ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:22.838168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63551789-9921-4d1a-89af-fc44f7395ee3 None admin] PATH_INFO: `/v3/users/e0110c3971e4498aaeb85a46f23db389` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:22.851783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63551789-9921-4d1a-89af-fc44f7395ee3 None admin] RBAC: Authorizing `identity:get_user(user_id=e0110c3971e4498aaeb85a46f23db389)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:22.853211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63551789-9921-4d1a-89af-fc44f7395ee3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:22.854791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 601/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:07:22 2022] GET /identity/v3/users/e0110c3971e4498aaeb85a46f23db389 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:22.860574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:22.957688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f73ed-3dce-4642-9f2d-26ac6a71f29a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:22.989860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6f94-652f-4c39-81f4-8d20f34d13a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:22.990447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6f94-652f-4c39-81f4-8d20f34d13a0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:22.990727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6f94-652f-4c39-81f4-8d20f34d13a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:22.991024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6f94-652f-4c39-81f4-8d20f34d13a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:23.030377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:23.055916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b6f94-652f-4c39-81f4-8d20f34d13a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:23.057342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b6f94-652f-4c39-81f4-8d20f34d13a0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:23.151266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 582/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:07:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:07:23.157349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63551789-9921-4d1a-89af-fc44f7395ee3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:23.254431 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63551789-9921-4d1a-89af-fc44f7395ee3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:23.287180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf5afc-3ccb-48ab-afce-0c7dccc02f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:23.287794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf5afc-3ccb-48ab-afce-0c7dccc02f41 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:23.288072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf5afc-3ccb-48ab-afce-0c7dccc02f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:23.288346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf5afc-3ccb-48ab-afce-0c7dccc02f41 None admin] PATH_INFO: `/v3/projects/774c68cbd2c54eb881c7521aa9b3a47f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:23.289477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf5afc-3ccb-48ab-afce-0c7dccc02f41 None admin] RBAC: Authorizing `identity:get_project(project_id=774c68cbd2c54eb881c7521aa9b3a47f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:23.290893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf5afc-3ccb-48ab-afce-0c7dccc02f41 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:23.292513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 602/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:07:23 2022] GET /identity/v3/projects/774c68cbd2c54eb881c7521aa9b3a47f => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:23.298558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6f94-652f-4c39-81f4-8d20f34d13a0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:23.371244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:23.400066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6f94-652f-4c39-81f4-8d20f34d13a0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:23.432721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628c456-e2ab-462c-9070-f73b61dfa2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:23.433318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c456-e2ab-462c-9070-f73b61dfa2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:23.433598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c456-e2ab-462c-9070-f73b61dfa2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:23.433872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c456-e2ab-462c-9070-f73b61dfa2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:23.434605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628c456-e2ab-462c-9070-f73b61dfa2f2 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=774c68cbd2c54eb881c7521aa9b3a47f, user.id=e0110c3971e4498aaeb85a46f23db389) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:23.434910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628c456-e2ab-462c-9070-f73b61dfa2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:23.436361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628c456-e2ab-462c-9070-f73b61dfa2f2 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:23.442330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 583/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:07:23 2022] GET /identity/v3/role_assignments?user.id=e0110c3971e4498aaeb85a46f23db389&scope.project.id=774c68cbd2c54eb881c7521aa9b3a47f&role.id=0f99070a6a88400199520fccd98977b6 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:25.564075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986274-cca0-4d6c-8ef2-aa6a1d5e1ccc None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:25.564587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986274-cca0-4d6c-8ef2-aa6a1d5e1ccc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:25.564678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b986274-cca0-4d6c-8ef2-aa6a1d5e1ccc None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:25.566683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 603/1186] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:25.572131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025095-fc6d-4ff3-a3cc-69ec53354c54 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:25.572561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025095-fc6d-4ff3-a3cc-69ec53354c54 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:25.572686 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96025095-fc6d-4ff3-a3cc-69ec53354c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:25.591484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-96025095-fc6d-4ff3-a3cc-69ec53354c54 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:25.592654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-96025095-fc6d-4ff3-a3cc-69ec53354c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:25.658504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 584/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:07:25.925088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b986274-cca0-4d6c-8ef2-aa6a1d5e1ccc None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:25.952622 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:26.025919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b986274-cca0-4d6c-8ef2-aa6a1d5e1ccc None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:26.059694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2430c63-189f-4e68-8e9e-fca488f95a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:26.060311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2430c63-189f-4e68-8e9e-fca488f95a35 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:26.060594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2430c63-189f-4e68-8e9e-fca488f95a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:26.060871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2430c63-189f-4e68-8e9e-fca488f95a35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:26.071411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2430c63-189f-4e68-8e9e-fca488f95a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c2430c63-189f-4e68-8e9e-fca488f95a35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:07:26.076160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:07:26.077241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:07:26.078277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 604/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:07:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:07:26.084155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025095-fc6d-4ff3-a3cc-69ec53354c54 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:26.147778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:26.181267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96025095-fc6d-4ff3-a3cc-69ec53354c54 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:26.214334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:26.214935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:26.215243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:26.215523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:26.216183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:26.216490 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:26.217840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:26.225978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 585/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:07:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:26.231903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2430c63-189f-4e68-8e9e-fca488f95a35 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:26.315513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:26.330763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2430c63-189f-4e68-8e9e-fca488f95a35 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:26.364333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dbb18-17fe-4fbf-94e2-2d69a362a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:26.364958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dbb18-17fe-4fbf-94e2-2d69a362a121 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:26.365241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dbb18-17fe-4fbf-94e2-2d69a362a121 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:26.365517 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dbb18-17fe-4fbf-94e2-2d69a362a121 None admin] PATH_INFO: `/v3/users/e0110c3971e4498aaeb85a46f23db389` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:26.366637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dbb18-17fe-4fbf-94e2-2d69a362a121 None admin] RBAC: Authorizing `identity:get_user(user_id=e0110c3971e4498aaeb85a46f23db389)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:26.368091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dbb18-17fe-4fbf-94e2-2d69a362a121 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:26.369659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 605/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:07:26 2022] GET /identity/v3/users/e0110c3971e4498aaeb85a46f23db389 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:26.375417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:26.473382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d4a61-82ac-4900-9f55-901d07c52713 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:26.498816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:26.507191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c2cfa-2cf0-44b5-be71-fb45ee197567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:26.507813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2cfa-2cf0-44b5-be71-fb45ee197567 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:26.508095 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2cfa-2cf0-44b5-be71-fb45ee197567 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:26.508371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2cfa-2cf0-44b5-be71-fb45ee197567 None admin] PATH_INFO: `/v3/projects/774c68cbd2c54eb881c7521aa9b3a47f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:26.509476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c2cfa-2cf0-44b5-be71-fb45ee197567 None admin] RBAC: Authorizing `identity:get_project(project_id=774c68cbd2c54eb881c7521aa9b3a47f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:26.510894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c2cfa-2cf0-44b5-be71-fb45ee197567 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:26.512555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 586/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:07:26 2022] GET /identity/v3/projects/774c68cbd2c54eb881c7521aa9b3a47f => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:26.518438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dbb18-17fe-4fbf-94e2-2d69a362a121 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:26.616667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dbb18-17fe-4fbf-94e2-2d69a362a121 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:26.650033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c276e8b4-8d26-4467-a8d5-43c38f5dcf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:26.650675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276e8b4-8d26-4467-a8d5-43c38f5dcf8f None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:26.650958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276e8b4-8d26-4467-a8d5-43c38f5dcf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:26.651266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276e8b4-8d26-4467-a8d5-43c38f5dcf8f None admin] PATH_INFO: `/v3/projects/774c68cbd2c54eb881c7521aa9b3a47f/users/e0110c3971e4498aaeb85a46f23db389/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:26.653150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276e8b4-8d26-4467-a8d5-43c38f5dcf8f None admin] RBAC: Authorizing `identity:create_grant(project_id=774c68cbd2c54eb881c7521aa9b3a47f, user_id=e0110c3971e4498aaeb85a46f23db389, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:26.654575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c276e8b4-8d26-4467-a8d5-43c38f5dcf8f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:26.667469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 606/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:07:26 2022] PUT /identity/v3/projects/774c68cbd2c54eb881c7521aa9b3a47f/users/e0110c3971e4498aaeb85a46f23db389/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:07:28.767424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837505b8-bd66-4051-839e-7020cd8e1af5 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:28.767962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837505b8-bd66-4051-839e-7020cd8e1af5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:28.767962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837505b8-bd66-4051-839e-7020cd8e1af5 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:28.769588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 587/1193] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:07:28.774971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8114a-147b-4088-acfb-bee94d6df292 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:28.775367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8114a-147b-4088-acfb-bee94d6df292 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:28.775547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8114a-147b-4088-acfb-bee94d6df292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:28.793186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f5d8114a-147b-4088-acfb-bee94d6df292 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:07:28.794362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f5d8114a-147b-4088-acfb-bee94d6df292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:07:28.803983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:28.860927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 607/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:07:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:07:29.132062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837505b8-bd66-4051-839e-7020cd8e1af5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:29.230199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837505b8-bd66-4051-839e-7020cd8e1af5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:29.262893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec700e90-7065-4f9d-a56c-658895ee469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:29.263538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec700e90-7065-4f9d-a56c-658895ee469b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:29.263813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec700e90-7065-4f9d-a56c-658895ee469b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:29.264084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec700e90-7065-4f9d-a56c-658895ee469b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:29.274375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec700e90-7065-4f9d-a56c-658895ee469b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ec700e90-7065-4f9d-a56c-658895ee469b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:07:29.279084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:07:29.280169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:07:29.281021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 588/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:07:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:07:29.287019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8114a-147b-4088-acfb-bee94d6df292 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:29.383787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8114a-147b-4088-acfb-bee94d6df292 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:29.417301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:29.417907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:29.418187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:29.418461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:29.419153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:29.419458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:29.420815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:29.428791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 608/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:07:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:29.434758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec700e90-7065-4f9d-a56c-658895ee469b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:29.490745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:29.533448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec700e90-7065-4f9d-a56c-658895ee469b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:29.566193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7041f-873c-4bb8-aef2-4a709a851cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:29.566807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7041f-873c-4bb8-aef2-4a709a851cfd None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:29.567112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7041f-873c-4bb8-aef2-4a709a851cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:29.567390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7041f-873c-4bb8-aef2-4a709a851cfd None admin] PATH_INFO: `/v3/users/e0110c3971e4498aaeb85a46f23db389` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:29.568492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7041f-873c-4bb8-aef2-4a709a851cfd None admin] RBAC: Authorizing `identity:get_user(user_id=e0110c3971e4498aaeb85a46f23db389)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:29.569905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7041f-873c-4bb8-aef2-4a709a851cfd None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:29.571505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 589/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Fri Sep 16 19:07:29 2022] GET /identity/v3/users/e0110c3971e4498aaeb85a46f23db389 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:29.577281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:29.587244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:29.676198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498abf0-2e95-4903-8f7a-b39b46faeabf None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:29.709475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5914bad-27cf-41e8-9178-e9794ec4f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:29.710075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5914bad-27cf-41e8-9178-e9794ec4f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:29.710356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5914bad-27cf-41e8-9178-e9794ec4f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:29.710632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5914bad-27cf-41e8-9178-e9794ec4f8a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:29.778299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5914bad-27cf-41e8-9178-e9794ec4f8a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:29.779774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5914bad-27cf-41e8-9178-e9794ec4f8a4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:29.787865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:29.876228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 609/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:07:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:07:29.882752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7041f-873c-4bb8-aef2-4a709a851cfd None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:29.977589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7041f-873c-4bb8-aef2-4a709a851cfd None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:30.000114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:30.011240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434d4ff-f03d-4e15-b106-18e2b3dd188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:30.011853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d4ff-f03d-4e15-b106-18e2b3dd188e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:30.012130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d4ff-f03d-4e15-b106-18e2b3dd188e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:30.012400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434d4ff-f03d-4e15-b106-18e2b3dd188e None admin] PATH_INFO: `/v3/projects/774c68cbd2c54eb881c7521aa9b3a47f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:30.013481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434d4ff-f03d-4e15-b106-18e2b3dd188e None admin] RBAC: Authorizing `identity:get_project(project_id=774c68cbd2c54eb881c7521aa9b3a47f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:30.014881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434d4ff-f03d-4e15-b106-18e2b3dd188e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:30.016495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 590/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Fri Sep 16 19:07:29 2022] GET /identity/v3/projects/774c68cbd2c54eb881c7521aa9b3a47f => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:30.024036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5914bad-27cf-41e8-9178-e9794ec4f8a4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:07:30.119283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5914bad-27cf-41e8-9178-e9794ec4f8a4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:07:30.126187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:30.152787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b7a0-5d67-468f-94e4-4370a37ae270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:07:30.153374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b7a0-5d67-468f-94e4-4370a37ae270 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:07:30.153649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b7a0-5d67-468f-94e4-4370a37ae270 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:07:30.153918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b7a0-5d67-468f-94e4-4370a37ae270 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:07:30.154622 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57b7a0-5d67-468f-94e4-4370a37ae270 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=774c68cbd2c54eb881c7521aa9b3a47f, user.id=e0110c3971e4498aaeb85a46f23db389) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:07:30.154920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57b7a0-5d67-468f-94e4-4370a37ae270 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:07:30.156346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57b7a0-5d67-468f-94e4-4370a37ae270 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:07:30.162189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 610/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:07:30 2022] GET /identity/v3/role_assignments?user.id=e0110c3971e4498aaeb85a46f23db389&scope.project.id=774c68cbd2c54eb881c7521aa9b3a47f&role.id=0f99070a6a88400199520fccd98977b6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:07:40.007250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:07:40.159474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=15 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:25.973579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094556-ef1a-4487-9cb3-778d7df1d15c None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:25.974159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094556-ef1a-4487-9cb3-778d7df1d15c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:25.974159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22094556-ef1a-4487-9cb3-778d7df1d15c None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:25.975862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 591/1201] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:08:25.981611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0429-66e2-4649-928d-9b00a603956b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:25.982170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0429-66e2-4649-928d-9b00a603956b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:25.982443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e0429-66e2-4649-928d-9b00a603956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:26.015459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-994e0429-66e2-4649-928d-9b00a603956b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:08:26.015459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-994e0429-66e2-4649-928d-9b00a603956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:08:26.112731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 611/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:08:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:08:26.406496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22094556-ef1a-4487-9cb3-778d7df1d15c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:26.553276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22094556-ef1a-4487-9cb3-778d7df1d15c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:26.602218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:26.602909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:26.603212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:26.603489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:26.617515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:26.619022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:26.641801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:26.642919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:26.643938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:26.643938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:26.643938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:26.643938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 592/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:26.651523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e0429-66e2-4649-928d-9b00a603956b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:26.791787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e0429-66e2-4649-928d-9b00a603956b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:26.835489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:26.843668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f9d42-fb6c-45a6-b336-599763d64c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:26.843668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f9d42-fb6c-45a6-b336-599763d64c3c None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:26.843668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f9d42-fb6c-45a6-b336-599763d64c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:26.845971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f9d42-fb6c-45a6-b336-599763d64c3c None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:26.846830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f9d42-fb6c-45a6-b336-599763d64c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:26.847212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f9d42-fb6c-45a6-b336-599763d64c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:26.848964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f9d42-fb6c-45a6-b336-599763d64c3c None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:26.863294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 612/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:26.868823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:26.938120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:27.004111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f896dc-4884-4c89-bbd4-81cf141c32ed None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:27.041738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b4c80-c413-463d-a66a-a202b1f14229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:27.042621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b4c80-c413-463d-a66a-a202b1f14229 None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:27.042849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b4c80-c413-463d-a66a-a202b1f14229 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:27.043158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b4c80-c413-463d-a66a-a202b1f14229 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:27.043964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b4c80-c413-463d-a66a-a202b1f14229 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:27.045482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b4c80-c413-463d-a66a-a202b1f14229 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:27.073780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 593/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Fri Sep 16 19:08:26 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:08:29.587319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454993f2-6f23-493d-84f6-215fce103529 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:29.587975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454993f2-6f23-493d-84f6-215fce103529 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:29.587975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454993f2-6f23-493d-84f6-215fce103529 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:29.589346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 613/1206] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:08:29.595784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172757-a436-44e6-8f22-94ce6b74558d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:29.596355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172757-a436-44e6-8f22-94ce6b74558d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:29.596355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172757-a436-44e6-8f22-94ce6b74558d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:29.618016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4f172757-a436-44e6-8f22-94ce6b74558d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:08:29.620168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4f172757-a436-44e6-8f22-94ce6b74558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:08:29.703045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 594/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:08:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:08:29.984486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454993f2-6f23-493d-84f6-215fce103529 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:30.105089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454993f2-6f23-493d-84f6-215fce103529 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:30.147703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f339ab-455e-4165-b849-2a44d9e28064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:30.148367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f339ab-455e-4165-b849-2a44d9e28064 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:30.148730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f339ab-455e-4165-b849-2a44d9e28064 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:30.149005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f339ab-455e-4165-b849-2a44d9e28064 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:30.160493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f339ab-455e-4165-b849-2a44d9e28064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-37f339ab-455e-4165-b849-2a44d9e28064 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:08:30.165477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:30.175310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:30.176207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 614/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:08:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:30.177018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f172757-a436-44e6-8f22-94ce6b74558d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:30.217626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:30.286844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f172757-a436-44e6-8f22-94ce6b74558d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:30.333966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:30.334585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:30.334861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:30.335159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:30.336058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:30.336369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:30.337884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:30.349284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 595/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:30.355322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f339ab-455e-4165-b849-2a44d9e28064 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:30.416343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:30.479564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f339ab-455e-4165-b849-2a44d9e28064 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:30.520779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:30.521544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:30.521888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:30.522228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:30.536017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:30.538608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:30.554095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:30.561488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:30.562478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:30.562478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:30.562478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:30.562478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 615/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:30.562723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:30.675171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:30.679704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0c73c-d0ec-4558-893e-f8fd7d7e648a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:30.719117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:30.719807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:30.720092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:30.720541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:30.721243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:30.721622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:30.723509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:30.743320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 596/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:30.744537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:30.857890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8363c9-fecd-4b20-92c7-03998526dc31 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:30.860104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:30.899799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:30.900876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:30.901318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:30.901778 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:30.911448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:30.913026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:08:30.924951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:30.926141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:30.929000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 616/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:30.936182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:31.053391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b816323-de16-4f4a-99eb-88fb1da64ee3 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:31.102041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:31.102851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:31.103238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:31.103726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:31.104633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:31.105065 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:31.107311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:31.135111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 597/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 19:08:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:31.139929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:31.258875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d541-4dc1-4d2a-8f15-c181e99ca271 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:31.302021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d805d-8775-4d6e-aa08-ac3971df9e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:31.302699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d805d-8775-4d6e-aa08-ac3971df9e19 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:31.302981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d805d-8775-4d6e-aa08-ac3971df9e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:31.303284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d805d-8775-4d6e-aa08-ac3971df9e19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:31.346078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:31.393830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d805d-8775-4d6e-aa08-ac3971df9e19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:31.395237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d805d-8775-4d6e-aa08-ac3971df9e19 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:31.526572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 617/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:08:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 19:08:31.532692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:31.562256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:31.661735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5f71-a557-4d78-826d-984e40ff5d31 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:31.703328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:31.704039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:31.704325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:31.704524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:31.717723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:31.719641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:31.740530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:31.741783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:31.742883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:31.742883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:31.742883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:31.742883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 598/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:08:31.748479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d805d-8775-4d6e-aa08-ac3971df9e19 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:31.825141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:31.869688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d805d-8775-4d6e-aa08-ac3971df9e19 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:31.910814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:31.911463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:31.911789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:31.912009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:31.912639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:31.912940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:31.914472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:31.926718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 618/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:31.934391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:32.018766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:32.050567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efaec5f-016a-4f15-aa44-50ddc24e35cc None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:32.087859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:32.088649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:32.089024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:32.089396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:32.097844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:32.100018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:08:32.113172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:32.114284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:32.115532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 599/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:08:32.120198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:32.237418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084615cb-77f3-4ced-9d0d-7370e9342904 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:32.270543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:32.285826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a12abe-90a5-442e-866b-750aa38afaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:32.286672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a12abe-90a5-442e-866b-750aa38afaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:32.287075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a12abe-90a5-442e-866b-750aa38afaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:32.287408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a12abe-90a5-442e-866b-750aa38afaa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:32.288362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a12abe-90a5-442e-866b-750aa38afaa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:32.288795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a12abe-90a5-442e-866b-750aa38afaa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:32.291012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a12abe-90a5-442e-866b-750aa38afaa9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:32.311030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 619/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:08:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:32.316935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:32.431126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d9252-5baf-4add-9510-033b1effeaaf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:32.463306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:32.470023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab6f1d-c74f-4f90-a133-7e74222bcb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:32.470634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6f1d-c74f-4f90-a133-7e74222bcb4e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:32.470915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6f1d-c74f-4f90-a133-7e74222bcb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:32.471296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab6f1d-c74f-4f90-a133-7e74222bcb4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:32.472097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6f1d-c74f-4f90-a133-7e74222bcb4e None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=4af8934abda44859938a55bf4daf83d3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:32.472420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6f1d-c74f-4f90-a133-7e74222bcb4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:32.474329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab6f1d-c74f-4f90-a133-7e74222bcb4e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:32.480341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 600/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:08:32 2022] GET /identity/v3/role_assignments?user.id=4af8934abda44859938a55bf4daf83d3&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:34.713533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f61d3-493b-44b6-88fd-47f9e46ab878 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:34.714159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f61d3-493b-44b6-88fd-47f9e46ab878 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:34.714290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f61d3-493b-44b6-88fd-47f9e46ab878 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:34.715733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 620/1220] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:08:34.721796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f6f7-4ead-4018-8970-00e274ee85a1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:34.722209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f6f7-4ead-4018-8970-00e274ee85a1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:34.722366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909f6f7-4ead-4018-8970-00e274ee85a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:34.742243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2909f6f7-4ead-4018-8970-00e274ee85a1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:08:34.743494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2909f6f7-4ead-4018-8970-00e274ee85a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:08:34.821116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 601/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:08:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:08:35.109817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f61d3-493b-44b6-88fd-47f9e46ab878 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:35.228533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f61d3-493b-44b6-88fd-47f9e46ab878 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:35.271081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f75260-d685-410d-be11-7b1109f09afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:35.271716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75260-d685-410d-be11-7b1109f09afc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:35.273130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75260-d685-410d-be11-7b1109f09afc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:35.273130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f75260-d685-410d-be11-7b1109f09afc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:35.284401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f75260-d685-410d-be11-7b1109f09afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-43f75260-d685-410d-be11-7b1109f09afc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:08:35.290149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:35.291286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:35.292277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 621/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:08:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:35.298413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f6f7-4ead-4018-8970-00e274ee85a1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:35.414983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909f6f7-4ead-4018-8970-00e274ee85a1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:35.444863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:35.457337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:35.458232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:35.458601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:35.458884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:35.459618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:35.460006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:35.461514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:35.477338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 602/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:08:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:35.478798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f75260-d685-410d-be11-7b1109f09afc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:35.539193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:35.615678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f75260-d685-410d-be11-7b1109f09afc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:35.672465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:35.673058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:35.673429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:35.673712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:35.685714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:35.689343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:35.717137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:35.718681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:35.719844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:35.719844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:35.719844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:35.719844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 622/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:35.725586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:35.855690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd53bd2-3fff-4137-933e-48ce38518b8b None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:35.895510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:35.896113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:35.896396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:35.896675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:35.897328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:35.897671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:35.899010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:35.911946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 603/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:35.918161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:36.059845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:36.068440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371d36e-d7e1-41e6-b72b-5521ddc32da5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:36.121490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:36.122147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:36.122427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:36.122694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:36.134536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:36.136794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:08:36.157665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:36.159174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:36.160538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 623/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:08:36.167201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:36.229824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:36.298469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508343d0-c590-439d-b01b-0df3021cc3e8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:36.340399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:36.341067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:36.341357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:36.341659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:36.342687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:36.343034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:36.344809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:36.365118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 604/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 19:08:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:08:36.374172 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:36.498049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b689ee-f4e1-40f3-aba8-0fb27384498f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:36.538094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:36.538900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:36.539252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:36.539537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:36.552000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:36.553611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:36.570724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:36.571969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:36.573083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:36.573083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:36.573083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:36.576883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 624/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:36.578359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:36.689866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0868-820f-4a8e-804f-4404ec56aadf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:36.692164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:36.728428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:36.729052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:36.729300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:36.729569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:36.730198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:36.730498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:36.731890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:36.744572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 605/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:08:36.750462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:36.760844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:36.872740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d3b26-32c9-4aae-91c7-9f086e977fdc None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:36.912510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:36.913290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:36.913575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:36.913851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:36.922651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:36.924267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:08:36.938385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:36.939629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:36.940635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 625/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:36.946212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:37.067532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec07762-5823-4b56-8a5b-48ec807ab4ee None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:37.115174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b8134-1d42-45b0-a3fc-edbd305c8359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:37.115873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b8134-1d42-45b0-a3fc-edbd305c8359 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:37.116248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b8134-1d42-45b0-a3fc-edbd305c8359 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:37.116622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b8134-1d42-45b0-a3fc-edbd305c8359 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:37.117309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b8134-1d42-45b0-a3fc-edbd305c8359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:37.117666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b8134-1d42-45b0-a3fc-edbd305c8359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:37.119314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b8134-1d42-45b0-a3fc-edbd305c8359 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:37.133451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 606/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:37.140174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:37.207838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:37.246054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879aabed-b1cd-4fb5-9379-0784c4fe1c55 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:37.289694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ac622-1295-448d-9015-fec1a8efa074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:37.290357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac622-1295-448d-9015-fec1a8efa074 None admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:37.290640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac622-1295-448d-9015-fec1a8efa074 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:37.290916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ac622-1295-448d-9015-fec1a8efa074 None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/4af8934abda44859938a55bf4daf83d3/roles/6caaeeebf7094f598c0e46561cb52144` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:37.306595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ac622-1295-448d-9015-fec1a8efa074 None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=4af8934abda44859938a55bf4daf83d3, role_id=6caaeeebf7094f598c0e46561cb52144)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:37.308085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ac622-1295-448d-9015-fec1a8efa074 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:37.320663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 626/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:08:37 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/4af8934abda44859938a55bf4daf83d3/roles/6caaeeebf7094f598c0e46561cb52144 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:08:39.570657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383031f-d685-4d3e-befa-821840333145 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:39.571305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383031f-d685-4d3e-befa-821840333145 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:39.571305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383031f-d685-4d3e-befa-821840333145 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:39.572561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 607/1233] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:08:39.578580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01973ec8-55aa-4797-a964-f43f7c11fa4a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:39.579149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01973ec8-55aa-4797-a964-f43f7c11fa4a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:39.579268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01973ec8-55aa-4797-a964-f43f7c11fa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:39.598217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-01973ec8-55aa-4797-a964-f43f7c11fa4a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:08:39.599434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-01973ec8-55aa-4797-a964-f43f7c11fa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:08:39.670498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 627/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:08:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:08:39.953612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383031f-d685-4d3e-befa-821840333145 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:39.981040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:40.070879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383031f-d685-4d3e-befa-821840333145 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:40.110118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c3efc-7000-4477-a41b-cb3caefe27e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:40.110762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c3efc-7000-4477-a41b-cb3caefe27e7 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:40.111072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c3efc-7000-4477-a41b-cb3caefe27e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:40.111384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c3efc-7000-4477-a41b-cb3caefe27e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:40.122793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c3efc-7000-4477-a41b-cb3caefe27e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-a94c3efc-7000-4477-a41b-cb3caefe27e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:08:40.128413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:40.129716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:40.130776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 608/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Fri Sep 16 19:08:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:40.135984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01973ec8-55aa-4797-a964-f43f7c11fa4a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:40.189748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:40.253716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01973ec8-55aa-4797-a964-f43f7c11fa4a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:40.291762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:40.292381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:40.292721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:40.293047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:40.293661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] RBAC: Adding query filter params (name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:40.293966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:40.295960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:40.304399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 628/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Fri Sep 16 19:08:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:40.313624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c3efc-7000-4477-a41b-cb3caefe27e7 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:40.410823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:40.427655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c3efc-7000-4477-a41b-cb3caefe27e7 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:40.465840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:40.466476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:40.466760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:40.467598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:40.478576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:40.480054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:40.495291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:40.496438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:40.497350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:40.497350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:40.497350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:40.497350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 609/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:40.503277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:40.611015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc717a-7742-4262-b277-b8b0fc35263f None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:40.621214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:40.650715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:40.651361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:40.651648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:40.651915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:40.652552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:40.652855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:40.654267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:40.668982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 629/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:40.675283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:40.786160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d736ed5-8e69-4e13-a912-691c0e9163f5 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:40.825057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:40.825927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:40.826947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:40.827327 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:40.830086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:40.836951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:40.838428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:08:40.851476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:40.853494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:40.854632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 610/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:40.859754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:40.976232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840c958-fe1c-4918-a0da-5ad1419e68a5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:41.013072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:41.013762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:41.014697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:41.014945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:41.015810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:41.016114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:41.017675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:41.042053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 630/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 19:08:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:41.043286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:41.172529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6402252-8c87-4419-9326-e4d9fc0e2c94 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:41.208885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf40284-e7ec-41da-b236-e71666e490a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:41.209495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf40284-e7ec-41da-b236-e71666e490a8 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:41.209774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf40284-e7ec-41da-b236-e71666e490a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:41.210047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf40284-e7ec-41da-b236-e71666e490a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:41.282295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:41.290951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf40284-e7ec-41da-b236-e71666e490a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:41.292620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf40284-e7ec-41da-b236-e71666e490a8 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:41.413078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 611/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:08:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:08:41.420155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:41.450824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:41.543862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1636393-d671-4b95-9351-14e09eba4752 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:41.586173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:41.586875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:41.587193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:41.587476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:41.599156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:41.600619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:41.617529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:41.623861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:41.624996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:41.624996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:41.624996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:41.624996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 631/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:08:41.625265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf40284-e7ec-41da-b236-e71666e490a8 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:41.736029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:41.742769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf40284-e7ec-41da-b236-e71666e490a8 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:41.782525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:41.783275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:41.783554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:41.783825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:41.784466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:41.784767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:41.786119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:41.799935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 612/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:41.805747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:41.896140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:41.919552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3aa00d-e467-4f3b-afd7-a8f00de63967 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:41.958887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:41.959554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:41.959850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:41.960110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:41.967531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:41.968974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:08:41.981588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:41.982824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:41.984460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 632/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:08:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:41.989592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:42.107408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe91d8-a236-4133-b70b-44ad74260555 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:42.149521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285a044-f9fd-4ea9-af93-055dbae1f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:42.150130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a044-f9fd-4ea9-af93-055dbae1f19f None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:42.150414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a044-f9fd-4ea9-af93-055dbae1f19f None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:42.150692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a044-f9fd-4ea9-af93-055dbae1f19f None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:42.151447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285a044-f9fd-4ea9-af93-055dbae1f19f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:42.151760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285a044-f9fd-4ea9-af93-055dbae1f19f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:42.153206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285a044-f9fd-4ea9-af93-055dbae1f19f None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:42.166735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 613/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:08:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:42.173388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:42.293230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f16a23-485c-4bdd-b12f-9b6dc28169e5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:42.330472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48ff27-aa5c-4b0c-852c-4815f95205be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:42.331166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48ff27-aa5c-4b0c-852c-4815f95205be None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:42.331493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48ff27-aa5c-4b0c-852c-4815f95205be None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:42.331807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48ff27-aa5c-4b0c-852c-4815f95205be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:42.332629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48ff27-aa5c-4b0c-852c-4815f95205be None admin] RBAC: Adding query filter params (role.id=6caaeeebf7094f598c0e46561cb52144, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=4af8934abda44859938a55bf4daf83d3) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:42.332944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48ff27-aa5c-4b0c-852c-4815f95205be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:42.334500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48ff27-aa5c-4b0c-852c-4815f95205be None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:42.340663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 633/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:08:42 2022] GET /identity/v3/role_assignments?user.id=4af8934abda44859938a55bf4daf83d3&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=6caaeeebf7094f598c0e46561cb52144 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:08:44.754052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae1e91-7fef-4c22-a2c1-6dbe73b72e86 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:44.754641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae1e91-7fef-4c22-a2c1-6dbe73b72e86 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:44.754641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae1e91-7fef-4c22-a2c1-6dbe73b72e86 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:44.756154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 614/1247] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:08:44.761448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8017-4c9f-4b88-a31a-fe53f6da85e1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:44.761891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8017-4c9f-4b88-a31a-fe53f6da85e1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:44.761994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe8017-4c9f-4b88-a31a-fe53f6da85e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:44.769455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:44.783724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8dbe8017-4c9f-4b88-a31a-fe53f6da85e1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:08:44.784980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8dbe8017-4c9f-4b88-a31a-fe53f6da85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:08:44.859974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 634/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:08:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:08:45.143811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae1e91-7fef-4c22-a2c1-6dbe73b72e86 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:45.163639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:45.252312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae1e91-7fef-4c22-a2c1-6dbe73b72e86 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:45.288432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d12efe-ef88-463d-808c-1e1329557fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:45.289072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12efe-ef88-463d-808c-1e1329557fab None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:45.289348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12efe-ef88-463d-808c-1e1329557fab None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:45.289619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d12efe-ef88-463d-808c-1e1329557fab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:45.301748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d12efe-ef88-463d-808c-1e1329557fab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-59d12efe-ef88-463d-808c-1e1329557fab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:08:45.306584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:45.307547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:45.308391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 615/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:45.314484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8017-4c9f-4b88-a31a-fe53f6da85e1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:45.418546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe8017-4c9f-4b88-a31a-fe53f6da85e1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:45.448794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:45.455388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:45.455998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:45.456274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:45.456543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:45.457199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:45.457504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:45.458936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:45.467707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 635/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:45.473940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d12efe-ef88-463d-808c-1e1329557fab None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:45.553718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:45.577625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d12efe-ef88-463d-808c-1e1329557fab None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:45.612772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:45.613407 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:45.613681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:45.613959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:45.625668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:45.627238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:45.641444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:45.642594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:45.643801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:45.643801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:45.643801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:45.643801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 616/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:45.649226 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:45.749060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed71d7-9425-46cd-a36b-52ac17732dbf None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:45.782417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:45.783031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:45.783316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:45.783588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:45.784211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:45.784511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:45.785850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:45.797499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 636/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:45.803220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:45.901917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79909c75-0aed-4add-a269-110cd4ebfd03 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:45.927219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:45.934936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:45.935611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:45.935895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:45.936173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:45.943375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:45.944798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:08:45.956214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:45.957173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:45.958227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 617/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:45.963114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:46.018287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:46.064218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873d074-8564-4263-b68d-fe83ab5befb4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:46.102404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:46.103449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:46.103737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:46.104189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:46.104955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:46.105320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:46.107443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:46.128675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 637/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 19:08:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:46.134718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:46.231704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74f41a-4ba5-44da-9cbc-034ec4629743 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:46.264531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62259b-2ae8-42f5-8498-f35d4189d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:46.265115 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62259b-2ae8-42f5-8498-f35d4189d68c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:46.265392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62259b-2ae8-42f5-8498-f35d4189d68c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:46.265662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62259b-2ae8-42f5-8498-f35d4189d68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:46.318239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:46.330986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62259b-2ae8-42f5-8498-f35d4189d68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:46.332447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62259b-2ae8-42f5-8498-f35d4189d68c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:46.425946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 618/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:08:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:08:46.431795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:46.529829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d5620-e7ab-49a4-8314-56302580be59 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:46.542447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:46.564039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:46.564656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:46.564933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:46.565204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:46.574949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:46.576891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:46.591120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:46.592857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:46.594129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:46.594129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:46.594129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:46.594129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 638/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:46.598853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62259b-2ae8-42f5-8498-f35d4189d68c None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:46.682926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:46.695008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62259b-2ae8-42f5-8498-f35d4189d68c None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:46.729302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:46.729901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:46.730178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:46.730450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:46.731113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:46.731416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:46.732790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:46.743497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 619/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:46.749472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:46.847485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441a71f-d703-4f9b-ad3b-c2dac7e37b34 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:46.879789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:46.880400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:46.880679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:46.880953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:46.887386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:46.889335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:08:46.900251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:46.901280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:46.902208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 639/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:46.907583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:47.005725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220404f-f113-434e-a076-c2da8a576fd0 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:47.038136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c86956-0a96-4cfa-8d87-1e258ce9cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:47.038717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c86956-0a96-4cfa-8d87-1e258ce9cfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:47.039021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c86956-0a96-4cfa-8d87-1e258ce9cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:47.039289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c86956-0a96-4cfa-8d87-1e258ce9cfc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:47.039961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c86956-0a96-4cfa-8d87-1e258ce9cfc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:47.040262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c86956-0a96-4cfa-8d87-1e258ce9cfc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:47.041659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c86956-0a96-4cfa-8d87-1e258ce9cfc5 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:47.053271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 620/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:08:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:47.059325 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:47.088897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:47.165751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d61a5-5d23-41ac-89aa-352c1a85f1b3 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:47.198132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b394a-52f4-47c1-bab1-2bbfe728a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:47.198732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b394a-52f4-47c1-bab1-2bbfe728a393 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:47.199032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b394a-52f4-47c1-bab1-2bbfe728a393 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:47.199310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b394a-52f4-47c1-bab1-2bbfe728a393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:47.200023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b394a-52f4-47c1-bab1-2bbfe728a393 None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=4af8934abda44859938a55bf4daf83d3) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:47.200331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b394a-52f4-47c1-bab1-2bbfe728a393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:47.202469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b394a-52f4-47c1-bab1-2bbfe728a393 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:47.207757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 640/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:08:47 2022] GET /identity/v3/role_assignments?user.id=4af8934abda44859938a55bf4daf83d3&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0f99070a6a88400199520fccd98977b6 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:49.345607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127ab4-af1d-4d32-8e77-de9b637c2cc7 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:49.346162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127ab4-af1d-4d32-8e77-de9b637c2cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:49.346162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1127ab4-af1d-4d32-8e77-de9b637c2cc7 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:49.347795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 621/1261] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:08:49.352824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d30d-fe32-4ac3-917e-d2d04a13f3a2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:49.353240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d30d-fe32-4ac3-917e-d2d04a13f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:49.353371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976d30d-fe32-4ac3-917e-d2d04a13f3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:49.371782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9976d30d-fe32-4ac3-917e-d2d04a13f3a2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:08:49.372985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9976d30d-fe32-4ac3-917e-d2d04a13f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:08:49.438860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 641/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:08:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:08:49.706168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1127ab4-af1d-4d32-8e77-de9b637c2cc7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:49.717565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:49.806317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1127ab4-af1d-4d32-8e77-de9b637c2cc7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:49.842904 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ab21-992d-44b1-ad58-4045424ab752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:49.843550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ab21-992d-44b1-ad58-4045424ab752 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:49.843830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ab21-992d-44b1-ad58-4045424ab752 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:49.844103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ab21-992d-44b1-ad58-4045424ab752 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:49.854059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164ab21-992d-44b1-ad58-4045424ab752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-4164ab21-992d-44b1-ad58-4045424ab752 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:08:49.858856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:49.860000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:49.861100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 622/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:49.866095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976d30d-fe32-4ac3-917e-d2d04a13f3a2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:49.884059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:49.968473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976d30d-fe32-4ac3-917e-d2d04a13f3a2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:50.002731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:50.003363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:50.003647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:50.003922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:50.004584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:50.004891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:50.006298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:50.014736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 642/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:50.020509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ab21-992d-44b1-ad58-4045424ab752 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:50.091040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:50.127306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ab21-992d-44b1-ad58-4045424ab752 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:50.163388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:50.164002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:50.164280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:50.164553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:50.174479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:50.175968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:50.190849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:50.192099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:50.193008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:50.193008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:50.193008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:50.193008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 623/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:08:50.197741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:50.277978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:50.297441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c80e22-2d7f-4323-a848-2e48b0a54730 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:50.330365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:50.330965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:50.331285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:50.331557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:50.332186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:50.332487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:50.333835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:50.345301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 643/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:50.351174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:50.448433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3e9c-02bd-4a11-83c0-abce6ea24c85 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:50.467429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:50.482311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:50.483094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:50.483378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:50.483653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:50.491626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:50.493051 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:08:50.504528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:50.505630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:50.506942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 624/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:50.511414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:50.608964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268a3ce-9f4b-4f53-924b-c3e642ce9a24 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:50.642057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:50.642654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:50.642933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:50.643236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:50.643947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:50.644254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:50.645669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:50.654243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:50.662728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 644/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 19:08:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:50.668553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:50.766226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417b24-458b-4795-8726-8a2b133f5c79 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:50.797619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:50.798223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:50.798503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:50.798775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:50.808779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:50.810709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:50.824276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:50.825353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:50.827334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:50.827334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:50.827334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:50.827334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 625/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:50.831547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:50.928337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3e4e4-2fd6-42c5-959f-ebb6beb729a4 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:50.961505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:50.962097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:50.962376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:50.962647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:50.963303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:50.963605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:50.964948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:50.976164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 645/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:50.981646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:51.012929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:51.083494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc204e-83ee-4b36-865e-c0ed32a453a1 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:51.121001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:51.121621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:51.121901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:51.122176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:51.129322 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:51.130744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:08:51.141727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:51.142771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:51.143737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 626/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:51.148666 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:51.208438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:51.252366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197492b-00e1-4d0e-a977-378656d7fc20 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:51.285675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf40e-f020-4053-9ebb-46b9c19f2939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:51.286308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf40e-f020-4053-9ebb-46b9c19f2939 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:51.286593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf40e-f020-4053-9ebb-46b9c19f2939 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:51.286869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf40e-f020-4053-9ebb-46b9c19f2939 None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:51.287588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf40e-f020-4053-9ebb-46b9c19f2939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:51.287894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf40e-f020-4053-9ebb-46b9c19f2939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:51.289315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf40e-f020-4053-9ebb-46b9c19f2939 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:51.301630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 646/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:51.307654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:51.397140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:51.406697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d2777-397e-4517-b625-980ab103ae0a None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:51.439229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c5e33-256c-4cf7-bc79-117eebff1e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:51.439892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5e33-256c-4cf7-bc79-117eebff1e63 None admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:51.440173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5e33-256c-4cf7-bc79-117eebff1e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:51.440451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c5e33-256c-4cf7-bc79-117eebff1e63 None admin] PATH_INFO: `/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/4af8934abda44859938a55bf4daf83d3/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:51.442302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c5e33-256c-4cf7-bc79-117eebff1e63 None admin] RBAC: Authorizing `identity:create_grant(project_id=58fc82bb1e764e4ca9766eda4a9d8ba4, user_id=4af8934abda44859938a55bf4daf83d3, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:51.443752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c5e33-256c-4cf7-bc79-117eebff1e63 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:51.456218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 627/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Fri Sep 16 19:08:51 2022] PUT /identity/v3/projects/58fc82bb1e764e4ca9766eda4a9d8ba4/users/4af8934abda44859938a55bf4daf83d3/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:08:53.553864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a234-5894-4ede-9c9a-b8f4c2ea4a60 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:53.554383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a234-5894-4ede-9c9a-b8f4c2ea4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:53.554383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a234-5894-4ede-9c9a-b8f4c2ea4a60 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:53.555805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 647/1274] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:08:53.561587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2690a8b-3be2-402a-8f33-d57e31346575 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:53.561998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2690a8b-3be2-402a-8f33-d57e31346575 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:53.562146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2690a8b-3be2-402a-8f33-d57e31346575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:53.580234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c2690a8b-3be2-402a-8f33-d57e31346575 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:08:53.581429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c2690a8b-3be2-402a-8f33-d57e31346575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:08:53.646163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 628/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:08:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:08:53.937040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9a234-5894-4ede-9c9a-b8f4c2ea4a60 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:54.038371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9a234-5894-4ede-9c9a-b8f4c2ea4a60 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:54.055344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:54.073508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb8f7a-4235-41a4-a9dd-f391829e467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:54.074136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb8f7a-4235-41a4-a9dd-f391829e467a None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:54.074409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb8f7a-4235-41a4-a9dd-f391829e467a None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:54.074681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb8f7a-4235-41a4-a9dd-f391829e467a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:54.087214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb8f7a-4235-41a4-a9dd-f391829e467a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-f7cb8f7a-4235-41a4-a9dd-f391829e467a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 19:08:54.092792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:54.094010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:54.095368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 648/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Fri Sep 16 19:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:54.100751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2690a8b-3be2-402a-8f33-d57e31346575 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:54.186328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:54.205187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2690a8b-3be2-402a-8f33-d57e31346575 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:54.238663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:54.239294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:54.239581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:54.239855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:54.240515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:54.240821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:54.242167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:54.249895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 629/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Fri Sep 16 19:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:54.255907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb8f7a-4235-41a4-a9dd-f391829e467a None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:54.354927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb8f7a-4235-41a4-a9dd-f391829e467a None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:54.387405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:54.388531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:54.388812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:54.389087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:54.398744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:54.400236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:54.415028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:54.416153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:54.417048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:54.417048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:54.417048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:54.417048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 649/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:54.421883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:54.519931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b20d67-1711-47db-b5c8-a7f7b5aec66e None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:54.551931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:54.552528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:54.552812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:54.553090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:54.553726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:54.554031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:54.555418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:54.567211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 630/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:54.572966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:54.603863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:54.672189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae377dfc-a06f-45d8-a308-61ff9ffa4075 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:54.705766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:54.706382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:54.706665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:54.706940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:54.714185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:54.715656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 19:08:54.726912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:54.728035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:54.729347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 650/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:54.733866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:54.737563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:54.832038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f1261-cd0c-494f-8ca4-0221fff1f588 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:54.864958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:54.865548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:54.865827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:54.866104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:54.866820 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:54.867158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:54.868575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:54.884938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 631/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Fri Sep 16 19:08:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:54.891275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:54.979822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:54.989602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d90bc9-926f-45ed-b28d-7ccbb95736e5 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:55.022519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148aa9f-6afa-4177-a318-48d2cafe75ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:55.023148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148aa9f-6afa-4177-a318-48d2cafe75ba None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:55.023433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148aa9f-6afa-4177-a318-48d2cafe75ba None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:55.023709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148aa9f-6afa-4177-a318-48d2cafe75ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:55.089263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148aa9f-6afa-4177-a318-48d2cafe75ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:55.090663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148aa9f-6afa-4177-a318-48d2cafe75ba None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:55.177160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:55.187937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 651/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Fri Sep 16 19:08:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 19:08:55.193856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:55.254298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:55.292039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad723c-dc8c-438e-aeee-20c91843f52d None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:55.325149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:55.325832 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:55.326112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:55.326385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:55.336091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:55.337511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 19:08:55.352321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:55.353410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 19:08:55.354594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 19:08:55.354594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 19:08:55.354594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:55.354594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 632/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:55.360081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148aa9f-6afa-4177-a318-48d2cafe75ba None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:55.456403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148aa9f-6afa-4177-a318-48d2cafe75ba None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:55.490336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:55.490932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:55.491239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:55.491508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:55.492141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:55.492438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:55.493794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:55.505045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 652/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Fri Sep 16 19:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:55.510749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:55.608469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8a54c-ae8a-4a15-bd5e-413e33d9cf27 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:55.621170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:55.641455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:55.642062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:55.642337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:55.642610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:55.649179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:55.650603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 19:08:55.663116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:55.664154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: ERROR keystone.server.flask.application Sep 16 19:08:55.665414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 633/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Fri Sep 16 19:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:55.670079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:55.719692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:55.768651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489623a-eef1-43ee-8d73-f1a65bb468b9 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:55.801201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f1db9-012c-4eb7-b47a-d26576961c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:55.801804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1db9-012c-4eb7-b47a-d26576961c7b None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:55.802084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1db9-012c-4eb7-b47a-d26576961c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:55.802357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1db9-012c-4eb7-b47a-d26576961c7b None admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:55.803078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1db9-012c-4eb7-b47a-d26576961c7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:55.803386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1db9-012c-4eb7-b47a-d26576961c7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:55.804813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1db9-012c-4eb7-b47a-d26576961c7b None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:55.816695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 653/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Fri Sep 16 19:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:55.822638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:55.920269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973786d-969d-43f0-9463-dfc362989caf None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:55.953468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f877f3-4d77-48e5-ad9a-7ed64eb9360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:55.954054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f877f3-4d77-48e5-ad9a-7ed64eb9360c None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:55.954331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f877f3-4d77-48e5-ad9a-7ed64eb9360c None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:55.954604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f877f3-4d77-48e5-ad9a-7ed64eb9360c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:55.955348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f877f3-4d77-48e5-ad9a-7ed64eb9360c None admin] RBAC: Adding query filter params (role.id=0f99070a6a88400199520fccd98977b6, scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4, user.id=4af8934abda44859938a55bf4daf83d3) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:55.955656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f877f3-4d77-48e5-ad9a-7ed64eb9360c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:55.957071 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f877f3-4d77-48e5-ad9a-7ed64eb9360c None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:55.962735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 634/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Fri Sep 16 19:08:55 2022] GET /identity/v3/role_assignments?user.id=4af8934abda44859938a55bf4daf83d3&scope.project.id=58fc82bb1e764e4ca9766eda4a9d8ba4&role.id=0f99070a6a88400199520fccd98977b6 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:58.134953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359610e3-2005-47ec-94b3-4816b3d2a367 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:58.135561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359610e3-2005-47ec-94b3-4816b3d2a367 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:58.135561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359610e3-2005-47ec-94b3-4816b3d2a367 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:58.137145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 654/1288] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:08:58.144677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aaf8e-9631-41e2-ac75-9fdcb3496645 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:58.145140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aaf8e-9631-41e2-ac75-9fdcb3496645 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:58.145264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779aaf8e-9631-41e2-ac75-9fdcb3496645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:58.167105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-779aaf8e-9631-41e2-ac75-9fdcb3496645 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:08:58.168463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-779aaf8e-9631-41e2-ac75-9fdcb3496645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:08:58.202977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:58.239992 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 635/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:08:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:08:58.536294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359610e3-2005-47ec-94b3-4816b3d2a367 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:58.636297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359610e3-2005-47ec-94b3-4816b3d2a367 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:58.647155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:08:58.671024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:58.671645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:58.671921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:58.672190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] PATH_INFO: `/v3/services/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:58.672760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:58.674103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:08:58.682543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:08:58.683786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:08:58.684800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 655/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:08:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:08:58.689979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779aaf8e-9631-41e2-ac75-9fdcb3496645 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:58.785991 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779aaf8e-9631-41e2-ac75-9fdcb3496645 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:58.819094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17315c4-7aa3-4762-b5b4-75d0e85656f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:58.819697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17315c4-7aa3-4762-b5b4-75d0e85656f0 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:58.819993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17315c4-7aa3-4762-b5b4-75d0e85656f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:58.820247 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17315c4-7aa3-4762-b5b4-75d0e85656f0 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:58.820870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17315c4-7aa3-4762-b5b4-75d0e85656f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:58.821174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17315c4-7aa3-4762-b5b4-75d0e85656f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:58.822520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17315c4-7aa3-4762-b5b4-75d0e85656f0 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:58.827355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 636/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 16 19:08:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:08:58.833119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:08:58.930715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f0c3b-e587-45cf-b02f-75098a7554da None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:08:58.962729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e1726-f7ad-4a13-ac96-4eb753970149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:08:58.963345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1726-f7ad-4a13-ac96-4eb753970149 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:08:58.963628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1726-f7ad-4a13-ac96-4eb753970149 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:08:58.963903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e1726-f7ad-4a13-ac96-4eb753970149 None admin] PATH_INFO: `/v3/services` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:08:58.964519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e1726-f7ad-4a13-ac96-4eb753970149 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:08:58.964823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e1726-f7ad-4a13-ac96-4eb753970149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:08:58.966687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e1726-f7ad-4a13-ac96-4eb753970149 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:08:58.971044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 656/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 16 19:08:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:09:01.079678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bdf3b-2c42-48e9-9261-85d87dc319c6 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:01.080269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bdf3b-2c42-48e9-9261-85d87dc319c6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:01.080269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bdf3b-2c42-48e9-9261-85d87dc319c6 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:01.081567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 637/1293] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:09:01.088249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea961b-c355-4f05-8951-8c67954557d6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:01.088618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea961b-c355-4f05-8951-8c67954557d6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:01.088799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea961b-c355-4f05-8951-8c67954557d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:01.108041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5cea961b-c355-4f05-8951-8c67954557d6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:09:01.109215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5cea961b-c355-4f05-8951-8c67954557d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:09:01.138662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:09:01.176352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 657/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:09:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:09:01.448109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bdf3b-2c42-48e9-9261-85d87dc319c6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:09:01.479452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:09:01.548457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bdf3b-2c42-48e9-9261-85d87dc319c6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:09:01.581269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce7cf6-3551-4260-bdbe-88872c53d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:09:01.581863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7cf6-3551-4260-bdbe-88872c53d4ba None admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:01.582140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7cf6-3551-4260-bdbe-88872c53d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:01.582413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce7cf6-3551-4260-bdbe-88872c53d4ba None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:01.583074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce7cf6-3551-4260-bdbe-88872c53d4ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:09:01.584436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce7cf6-3551-4260-bdbe-88872c53d4ba None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:09:01.598394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 638/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Fri Sep 16 19:09:01 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:09:03.742064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149f15-64e5-455f-9311-f2b53ccc4ca0 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:03.742579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149f15-64e5-455f-9311-f2b53ccc4ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:03.742671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149f15-64e5-455f-9311-f2b53ccc4ca0 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:03.743982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 658/1296] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:09:03.749726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f9ea-85e7-4508-baf6-e477652117af None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:03.750098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f9ea-85e7-4508-baf6-e477652117af None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:03.750280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35f9ea-85e7-4508-baf6-e477652117af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:03.768734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9b35f9ea-85e7-4508-baf6-e477652117af None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:09:03.769919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9b35f9ea-85e7-4508-baf6-e477652117af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:09:03.840431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 639/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:09:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:09:04.107070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149f15-64e5-455f-9311-f2b53ccc4ca0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:09:04.206590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149f15-64e5-455f-9311-f2b53ccc4ca0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:09:04.239343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:09:04.239963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:04.240243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:04.240518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:04.241098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:09:04.242463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:09:04.251671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:09:04.252836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:09:04.253875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 659/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:09:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 19:09:04.258732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35f9ea-85e7-4508-baf6-e477652117af None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:09:04.277245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:09:04.355989 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35f9ea-85e7-4508-baf6-e477652117af None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:09:04.389897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:09:04.390431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:04.390712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:04.390980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:04.391627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:09:04.391926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:09:04.393268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:09:04.398427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 640/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 16 19:09:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:09:04.404618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:09:04.436327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:09:04.504083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c61de-4e36-4144-900d-d890f0772412 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:09:04.536661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b00b18-4ed7-4419-afcc-57d484dd6de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:09:04.537260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00b18-4ed7-4419-afcc-57d484dd6de5 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:04.537540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00b18-4ed7-4419-afcc-57d484dd6de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:04.537816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b00b18-4ed7-4419-afcc-57d484dd6de5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:04.538504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b00b18-4ed7-4419-afcc-57d484dd6de5 None admin] RBAC: Adding query filter params (interface=public, service_id=78483a19758948fda4039a89a633a202, region_id=RegionOne) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:09:04.538812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b00b18-4ed7-4419-afcc-57d484dd6de5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:09:04.540197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b00b18-4ed7-4419-afcc-57d484dd6de5 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:09:04.545659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 660/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Fri Sep 16 19:09:04 2022] GET /identity/v3/endpoints?service_id=78483a19758948fda4039a89a633a202&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:09:04.551278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:09:04.630634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:09:04.649017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a80fd-5ac5-497a-a273-855246e48b75 None admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:09:04.681851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756ea2-3fd9-48fe-867e-8f134b398d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:09:04.682443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756ea2-3fd9-48fe-867e-8f134b398d4d None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:04.682723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756ea2-3fd9-48fe-867e-8f134b398d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:04.683012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756ea2-3fd9-48fe-867e-8f134b398d4d None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:04.683623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c756ea2-3fd9-48fe-867e-8f134b398d4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:09:04.685161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c756ea2-3fd9-48fe-867e-8f134b398d4d None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:09:04.691782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 641/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Fri Sep 16 19:09:04 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:09:06.810041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2719b-1be3-416f-b4cb-ba41e4afb37e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:06.810592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2719b-1be3-416f-b4cb-ba41e4afb37e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:06.810592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2719b-1be3-416f-b4cb-ba41e4afb37e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:06.811992 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 661/1302] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:09:06.817070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9e33-b742-4f1b-9891-6d330defff03 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:06.817505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9e33-b742-4f1b-9891-6d330defff03 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:06.817629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9e33-b742-4f1b-9891-6d330defff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:06.835926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-342e9e33-b742-4f1b-9891-6d330defff03 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:09:06.837112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-342e9e33-b742-4f1b-9891-6d330defff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:09:06.901977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 642/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:09:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 19:09:07.168926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2719b-1be3-416f-b4cb-ba41e4afb37e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:09:07.262199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:09:07.269041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2719b-1be3-416f-b4cb-ba41e4afb37e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:09:07.302324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469101a-560d-4938-a023-3364968827e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:09:07.302941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469101a-560d-4938-a023-3364968827e6 None admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:07.303250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469101a-560d-4938-a023-3364968827e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:07.303526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469101a-560d-4938-a023-3364968827e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:07.304105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469101a-560d-4938-a023-3364968827e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:09:07.305460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469101a-560d-4938-a023-3364968827e6 None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application [None req-3469101a-560d-4938-a023-3364968827e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 19:09:07.314223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 19:09:07.315420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application with Lock( Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self._enter() Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application return self.creator() Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application created_value = creator( Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: ERROR keystone.server.flask.application Sep 16 19:09:07.316263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 662/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Fri Sep 16 19:09:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 19:09:07.321247 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e9e33-b742-4f1b-9891-6d330defff03 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:09:07.394914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:09:07.417601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e9e33-b742-4f1b-9891-6d330defff03 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:09:07.453554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a24ae-8a92-45e6-93bf-968065b004fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:09:07.454161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a24ae-8a92-45e6-93bf-968065b004fc None admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:07.454444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a24ae-8a92-45e6-93bf-968065b004fc None admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:07.454719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a24ae-8a92-45e6-93bf-968065b004fc None admin] PATH_INFO: `/v3/services` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:07.455387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a24ae-8a92-45e6-93bf-968065b004fc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:09:07.455697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a24ae-8a92-45e6-93bf-968065b004fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:09:07.457047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a24ae-8a92-45e6-93bf-968065b004fc None admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:09:07.462014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 643/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Fri Sep 16 19:09:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:09:07.468229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469101a-560d-4938-a023-3364968827e6 None admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:09:07.567150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469101a-560d-4938-a023-3364968827e6 None admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:09:07.599793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb22a52-365e-497d-a355-68d2a83ba0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:09:07.600385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22a52-365e-497d-a355-68d2a83ba0ba None admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:09:07.600663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22a52-365e-497d-a355-68d2a83ba0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:09:07.600936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb22a52-365e-497d-a355-68d2a83ba0ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:09:07.601584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22a52-365e-497d-a355-68d2a83ba0ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:09:07.602929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb22a52-365e-497d-a355-68d2a83ba0ba None admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:09:07.622425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 663/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:09:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:09:17.459243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=30 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:09:17.618566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:11.860667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1199b2e-332c-4681-b6a9-ff5a2b6e444e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:11.861131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1199b2e-332c-4681-b6a9-ff5a2b6e444e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:11.861223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1199b2e-332c-4681-b6a9-ff5a2b6e444e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:11.862562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 644/1307] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:11.868061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d80d4-2e89-4fbf-b42f-f90359ea57c3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:11.868483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d80d4-2e89-4fbf-b42f-f90359ea57c3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:11.868613 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d80d4-2e89-4fbf-b42f-f90359ea57c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:11.987144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e30d80d4-2e89-4fbf-b42f-f90359ea57c3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:11.988627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e30d80d4-2e89-4fbf-b42f-f90359ea57c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:12.103035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 664/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:12.399837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee1e19-1ecf-4d0e-b885-8cefe77545ed None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:12.400436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee1e19-1ecf-4d0e-b885-8cefe77545ed None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:12.400827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee1e19-1ecf-4d0e-b885-8cefe77545ed None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:12.402305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 645/1309] 10.222.0.20 () {54 vars in 963 bytes} [Fri Sep 16 19:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:12.409059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53829bfa-cf54-44a7-82a5-42b50819e5ee None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:12.409519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53829bfa-cf54-44a7-82a5-42b50819e5ee None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:12.409906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53829bfa-cf54-44a7-82a5-42b50819e5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:12.502370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-53829bfa-cf54-44a7-82a5-42b50819e5ee None None] MFA Rules not processed for user `1c0ab0eca7de4bed89b5f292a52f8c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:12.503918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-53829bfa-cf54-44a7-82a5-42b50819e5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:12.526911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:12.588293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 665/1310] 10.222.0.20 () {58 vars in 1060 bytes} [Fri Sep 16 19:10:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:12.597699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee1e19-1ecf-4d0e-b885-8cefe77545ed None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:12.599662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e3ee1e19-1ecf-4d0e-b885-8cefe77545ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:12.721293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee1e19-1ecf-4d0e-b885-8cefe77545ed None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:12.802609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e9555-7e57-4ea8-87f8-3b0a8ead3786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:12.803350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9555-7e57-4ea8-87f8-3b0a8ead3786 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:12.803701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9555-7e57-4ea8-87f8-3b0a8ead3786 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:12.804093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e9555-7e57-4ea8-87f8-3b0a8ead3786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:12.806315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-480e9555-7e57-4ea8-87f8-3b0a8ead3786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:12.865665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:12.931464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9555-7e57-4ea8-87f8-3b0a8ead3786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:12.932853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e9555-7e57-4ea8-87f8-3b0a8ead3786 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:12.954738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 646/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:15.417308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040258-268d-4fdb-b67d-7c95339bbe45 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:15.417807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040258-268d-4fdb-b67d-7c95339bbe45 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:15.417896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59040258-268d-4fdb-b67d-7c95339bbe45 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:15.419251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 666/1312] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:15.424555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050e8ff-f59a-45ca-8e32-c8e6c9ee7991 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:15.424981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050e8ff-f59a-45ca-8e32-c8e6c9ee7991 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:15.425231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050e8ff-f59a-45ca-8e32-c8e6c9ee7991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:15.509019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6050e8ff-f59a-45ca-8e32-c8e6c9ee7991 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:15.510158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6050e8ff-f59a-45ca-8e32-c8e6c9ee7991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:15.607746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 647/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:15.895990 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040258-268d-4fdb-b67d-7c95339bbe45 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:15.897541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-59040258-268d-4fdb-b67d-7c95339bbe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:16.009767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59040258-268d-4fdb-b67d-7c95339bbe45 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:16.083322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:16.085837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67194e8e-0b73-4e8a-877e-83f0268ec2f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:16.086702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194e8e-0b73-4e8a-877e-83f0268ec2f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:16.087227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194e8e-0b73-4e8a-877e-83f0268ec2f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:16.087738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194e8e-0b73-4e8a-877e-83f0268ec2f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:16.089348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-67194e8e-0b73-4e8a-877e-83f0268ec2f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:16.202851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67194e8e-0b73-4e8a-877e-83f0268ec2f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:16.204328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67194e8e-0b73-4e8a-877e-83f0268ec2f3 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:16.223182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 667/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:18.657780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbdaf8-22ab-4b6c-b092-ccbffa7cf8d9 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:18.658347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbdaf8-22ab-4b6c-b092-ccbffa7cf8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:18.658347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbdaf8-22ab-4b6c-b092-ccbffa7cf8d9 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:18.659749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 648/1315] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:18.665379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ff0e-73d1-4213-b3ca-8f793bbd8b06 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:18.665793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ff0e-73d1-4213-b3ca-8f793bbd8b06 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:18.665943 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ff0e-73d1-4213-b3ca-8f793bbd8b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:18.732022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7510ff0e-73d1-4213-b3ca-8f793bbd8b06 None None] MFA Rules not processed for user `2340bd445eaf442b8b01340293637271`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:18.733497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7510ff0e-73d1-4213-b3ca-8f793bbd8b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:18.784551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:18.828408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 668/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:18 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:19.110871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbdaf8-22ab-4b6c-b092-ccbffa7cf8d9 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:19.112455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e7dbdaf8-22ab-4b6c-b092-ccbffa7cf8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:19.122852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:19.216097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbdaf8-22ab-4b6c-b092-ccbffa7cf8d9 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:19.290872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b2840-b288-493d-b3ed-59e32d595de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:19.291496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b2840-b288-493d-b3ed-59e32d595de3 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:19.291775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b2840-b288-493d-b3ed-59e32d595de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:19.292047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b2840-b288-493d-b3ed-59e32d595de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:19.293626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f30b2840-b288-493d-b3ed-59e32d595de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:19.354622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:19.400279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b2840-b288-493d-b3ed-59e32d595de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:19.401652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b2840-b288-493d-b3ed-59e32d595de3 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:19.420229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 649/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:22.099459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553810a-d841-4511-905f-1491222930d4 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:22.100014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553810a-d841-4511-905f-1491222930d4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:22.100014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553810a-d841-4511-905f-1491222930d4 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:22.101683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 669/1318] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:22.106909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1730ed-28f9-466d-8171-0e527858b888 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:22.107355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1730ed-28f9-466d-8171-0e527858b888 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:22.107480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1730ed-28f9-466d-8171-0e527858b888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:22.171520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ca1730ed-28f9-466d-8171-0e527858b888 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:22.172725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ca1730ed-28f9-466d-8171-0e527858b888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:22.267548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 650/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:22.565998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4061bc-d8a0-47a5-9237-2d79bcd283fb None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:22.566275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4061bc-d8a0-47a5-9237-2d79bcd283fb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:22.566554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4061bc-d8a0-47a5-9237-2d79bcd283fb None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:22.567927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 670/1320] 10.222.0.20 () {54 vars in 963 bytes} [Fri Sep 16 19:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:22.573504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38cad-80a1-49ae-a001-7edd2203ac92 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:22.573819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38cad-80a1-49ae-a001-7edd2203ac92 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:22.574094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38cad-80a1-49ae-a001-7edd2203ac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:22.596116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:22.651097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6dc38cad-80a1-49ae-a001-7edd2203ac92 None None] MFA Rules not processed for user `1c0ab0eca7de4bed89b5f292a52f8c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:22.652305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6dc38cad-80a1-49ae-a001-7edd2203ac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:22.728382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 651/1321] 10.222.0.20 () {58 vars in 1060 bytes} [Fri Sep 16 19:10:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:22.737304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4061bc-d8a0-47a5-9237-2d79bcd283fb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:22.738809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8f4061bc-d8a0-47a5-9237-2d79bcd283fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:22.840445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4061bc-d8a0-47a5-9237-2d79bcd283fb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:22.913457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504a116-a287-4fdb-820d-ed8b3b0a9445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:22.914055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a116-a287-4fdb-820d-ed8b3b0a9445 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:22.914331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a116-a287-4fdb-820d-ed8b3b0a9445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:22.914602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504a116-a287-4fdb-820d-ed8b3b0a9445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:22.916202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3504a116-a287-4fdb-820d-ed8b3b0a9445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:22.922861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:23.025054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504a116-a287-4fdb-820d-ed8b3b0a9445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:23.026401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504a116-a287-4fdb-820d-ed8b3b0a9445 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:23.043684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 671/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:26.311932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65435806-ce24-434f-a9a5-e59806866045 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:26.312460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65435806-ce24-434f-a9a5-e59806866045 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:26.312542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65435806-ce24-434f-a9a5-e59806866045 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:26.314046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 652/1323] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:26.319907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc918-ff7d-4496-ab0e-585005688b86 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:26.320416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc918-ff7d-4496-ab0e-585005688b86 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:26.320514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dc918-ff7d-4496-ab0e-585005688b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:26.393236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9c9dc918-ff7d-4496-ab0e-585005688b86 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:26.394497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9c9dc918-ff7d-4496-ab0e-585005688b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:26.461088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:26.503808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 672/1324] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:26.788488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65435806-ce24-434f-a9a5-e59806866045 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:26.790011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-65435806-ce24-434f-a9a5-e59806866045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:26.895875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65435806-ce24-434f-a9a5-e59806866045 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:26.908424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:26.974098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbd328-d40c-41fd-8b54-d7a5d53e227e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:26.974706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbd328-d40c-41fd-8b54-d7a5d53e227e service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:26.975178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbd328-d40c-41fd-8b54-d7a5d53e227e service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:26.975532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbd328-d40c-41fd-8b54-d7a5d53e227e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:26.977213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b4dbd328-d40c-41fd-8b54-d7a5d53e227e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:27.090002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbd328-d40c-41fd-8b54-d7a5d53e227e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:27.091597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbd328-d40c-41fd-8b54-d7a5d53e227e service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:27.110143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 653/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:29.360478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08830d2-1c4e-410c-900e-246d78f2d63e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:29.361020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08830d2-1c4e-410c-900e-246d78f2d63e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:29.361020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08830d2-1c4e-410c-900e-246d78f2d63e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:29.362392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 673/1326] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:29.367743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d828-f850-40ac-b6ae-8b73d7ab9457 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:29.368167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d828-f850-40ac-b6ae-8b73d7ab9457 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:29.368260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30d828-f850-40ac-b6ae-8b73d7ab9457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:29.426153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:29.447640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1d30d828-f850-40ac-b6ae-8b73d7ab9457 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:29.448865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1d30d828-f850-40ac-b6ae-8b73d7ab9457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:29.545741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 654/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:29.829761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08830d2-1c4e-410c-900e-246d78f2d63e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:29.831362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b08830d2-1c4e-410c-900e-246d78f2d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:29.937675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08830d2-1c4e-410c-900e-246d78f2d63e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:30.013828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbf8b5-c722-4cfa-a563-1f41c7ac0778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:30.014429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbf8b5-c722-4cfa-a563-1f41c7ac0778 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:30.014703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbf8b5-c722-4cfa-a563-1f41c7ac0778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:30.014969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbf8b5-c722-4cfa-a563-1f41c7ac0778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:30.016561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a3dbf8b5-c722-4cfa-a563-1f41c7ac0778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:30.034651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:30.133159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbf8b5-c722-4cfa-a563-1f41c7ac0778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:30.134505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbf8b5-c722-4cfa-a563-1f41c7ac0778 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:30.152962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 674/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:32.380840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee81c2-95bc-42af-a46b-8852f6a5fa98 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:32.381338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee81c2-95bc-42af-a46b-8852f6a5fa98 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:32.381338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee81c2-95bc-42af-a46b-8852f6a5fa98 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:32.382637 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 655/1329] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:32.387963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0983db-b590-47c9-a7ac-970df87687c5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:32.388377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0983db-b590-47c9-a7ac-970df87687c5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:32.388520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0983db-b590-47c9-a7ac-970df87687c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:32.455473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bd0983db-b590-47c9-a7ac-970df87687c5 None None] MFA Rules not processed for user `2340bd445eaf442b8b01340293637271`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:32.456709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bd0983db-b590-47c9-a7ac-970df87687c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:32.521699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:32.555038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 675/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:32.843551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee81c2-95bc-42af-a46b-8852f6a5fa98 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:32.845373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-63ee81c2-95bc-42af-a46b-8852f6a5fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:32.950670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee81c2-95bc-42af-a46b-8852f6a5fa98 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:32.972221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:33.027279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421c872-95be-4169-ae8d-60465e865570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:33.027883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c872-95be-4169-ae8d-60465e865570 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:33.028159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c872-95be-4169-ae8d-60465e865570 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:33.028428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421c872-95be-4169-ae8d-60465e865570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:33.030107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0421c872-95be-4169-ae8d-60465e865570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:33.141722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421c872-95be-4169-ae8d-60465e865570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:33.143388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421c872-95be-4169-ae8d-60465e865570 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:33.164609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 656/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:35.588491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a056b-5e94-43e6-aa43-78351abd4499 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:35.589028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a056b-5e94-43e6-aa43-78351abd4499 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:35.589028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a056b-5e94-43e6-aa43-78351abd4499 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:35.590380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 676/1332] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:35.596032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8406-e792-4bbc-9752-b6ca3f11e391 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:35.596459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8406-e792-4bbc-9752-b6ca3f11e391 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:35.596571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac8406-e792-4bbc-9752-b6ca3f11e391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:35.665377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:35.668403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-92ac8406-e792-4bbc-9752-b6ca3f11e391 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:35.670293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-92ac8406-e792-4bbc-9752-b6ca3f11e391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:35.787406 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 657/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:36.109960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a056b-5e94-43e6-aa43-78351abd4499 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:36.111747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c89a056b-5e94-43e6-aa43-78351abd4499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:36.217517 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a056b-5e94-43e6-aa43-78351abd4499 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:36.295785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e2966-020f-45c3-886d-c02474a96510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:36.296386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2966-020f-45c3-886d-c02474a96510 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:36.296664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2966-020f-45c3-886d-c02474a96510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:36.296931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e2966-020f-45c3-886d-c02474a96510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:36.298495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-087e2966-020f-45c3-886d-c02474a96510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:36.325668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:36.432540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e2966-020f-45c3-886d-c02474a96510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:36.433882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e2966-020f-45c3-886d-c02474a96510 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:36.453942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 677/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:38.638145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65757b-8cd7-4624-97d1-004cbaded007 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:38.638707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65757b-8cd7-4624-97d1-004cbaded007 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:38.638707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65757b-8cd7-4624-97d1-004cbaded007 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:38.640074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 658/1335] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:38.645217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70df4-e8c7-4f0d-8de3-7e8b507f22dc None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:38.645635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70df4-e8c7-4f0d-8de3-7e8b507f22dc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:38.645774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70df4-e8c7-4f0d-8de3-7e8b507f22dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:38.711987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-11b70df4-e8c7-4f0d-8de3-7e8b507f22dc None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:38.713194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-11b70df4-e8c7-4f0d-8de3-7e8b507f22dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:38.786625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:38.809483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 678/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:39.091712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65757b-8cd7-4624-97d1-004cbaded007 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:39.093230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9f65757b-8cd7-4624-97d1-004cbaded007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:39.196808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65757b-8cd7-4624-97d1-004cbaded007 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:39.226456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:39.271666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff8654-77ad-48ef-b385-a5009b115677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:39.272275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8654-77ad-48ef-b385-a5009b115677 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:39.272557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8654-77ad-48ef-b385-a5009b115677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:39.272833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff8654-77ad-48ef-b385-a5009b115677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:39.274467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0cff8654-77ad-48ef-b385-a5009b115677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:39.382250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff8654-77ad-48ef-b385-a5009b115677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:39.383636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff8654-77ad-48ef-b385-a5009b115677 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:39.402141 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 659/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:41.945615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d5728-7d05-46d8-9609-87c6ca3e9bc1 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:41.946215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d5728-7d05-46d8-9609-87c6ca3e9bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:41.946215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d5728-7d05-46d8-9609-87c6ca3e9bc1 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:41.947572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 679/1338] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:41.952941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020f29-f64a-4fbb-9db4-7834689b0f49 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:41.953377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020f29-f64a-4fbb-9db4-7834689b0f49 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:41.953479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44020f29-f64a-4fbb-9db4-7834689b0f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:42.021943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-44020f29-f64a-4fbb-9db4-7834689b0f49 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:42.023203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-44020f29-f64a-4fbb-9db4-7834689b0f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:42.031419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:42.121073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 660/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:42.405874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d5728-7d05-46d8-9609-87c6ca3e9bc1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:42.407543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-439d5728-7d05-46d8-9609-87c6ca3e9bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:42.511606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d5728-7d05-46d8-9609-87c6ca3e9bc1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:42.584639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebcc25b-22be-4596-b61f-f485a6bba1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:42.585237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcc25b-22be-4596-b61f-f485a6bba1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:42.585515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcc25b-22be-4596-b61f-f485a6bba1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:42.585785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebcc25b-22be-4596-b61f-f485a6bba1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:42.587432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8ebcc25b-22be-4596-b61f-f485a6bba1b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:42.622987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:42.696541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcc25b-22be-4596-b61f-f485a6bba1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:42.697971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebcc25b-22be-4596-b61f-f485a6bba1b6 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:42.716674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 680/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:46.823304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4e45-92f9-4cbd-8d3e-061a08f95058 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:46.823831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4e45-92f9-4cbd-8d3e-061a08f95058 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:46.823831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4e45-92f9-4cbd-8d3e-061a08f95058 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:46.826342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 661/1341] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:46.830402 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe69f-1168-42c0-92cd-c7600317efba None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:46.830839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe69f-1168-42c0-92cd-c7600317efba None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:46.830953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebe69f-1168-42c0-92cd-c7600317efba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:46.902889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-85ebe69f-1168-42c0-92cd-c7600317efba None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:46.904141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-85ebe69f-1168-42c0-92cd-c7600317efba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:46.998485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:47.010253 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 681/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:10:47.295520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de4e45-92f9-4cbd-8d3e-061a08f95058 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:47.297114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a7de4e45-92f9-4cbd-8d3e-061a08f95058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:47.401504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de4e45-92f9-4cbd-8d3e-061a08f95058 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:47.440259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:47.477769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db7b31-e672-4a8e-9045-23783b482d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:47.478377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7b31-e672-4a8e-9045-23783b482d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:47.478656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7b31-e672-4a8e-9045-23783b482d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:47.478930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7b31-e672-4a8e-9045-23783b482d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:47.480551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-37db7b31-e672-4a8e-9045-23783b482d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:47.588393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db7b31-e672-4a8e-9045-23783b482d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:47.589733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db7b31-e672-4a8e-9045-23783b482d20 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:47.608669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 662/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:50.540381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf6f7a-98e9-4703-822f-efa586b876ed None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:50.540932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf6f7a-98e9-4703-822f-efa586b876ed None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:50.540932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf6f7a-98e9-4703-822f-efa586b876ed None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:50.542268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 682/1344] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:50.547378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fafb05-9abd-4448-b5c2-e601013eb7b3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:50.547794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fafb05-9abd-4448-b5c2-e601013eb7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:50.548007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fafb05-9abd-4448-b5c2-e601013eb7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:50.616504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-19fafb05-9abd-4448-b5c2-e601013eb7b3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:50.617779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-19fafb05-9abd-4448-b5c2-e601013eb7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:50.638428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:50.721506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 663/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:10:51.007617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf6f7a-98e9-4703-822f-efa586b876ed None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:51.009149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fdcf6f7a-98e9-4703-822f-efa586b876ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:51.120183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf6f7a-98e9-4703-822f-efa586b876ed None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:51.198649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a0dfe-176b-4c58-ba91-02931b1d7977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:51.199283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a0dfe-176b-4c58-ba91-02931b1d7977 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:51.199564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a0dfe-176b-4c58-ba91-02931b1d7977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:51.199837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a0dfe-176b-4c58-ba91-02931b1d7977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:51.201417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4f3a0dfe-176b-4c58-ba91-02931b1d7977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:51.245145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:51.320142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a0dfe-176b-4c58-ba91-02931b1d7977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:51.331256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a0dfe-176b-4c58-ba91-02931b1d7977 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:51.355576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 683/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:10:55.664359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a817f3-fb39-45a1-b8c1-6e18a3b3c884 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:55.664849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a817f3-fb39-45a1-b8c1-6e18a3b3c884 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:55.664963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a817f3-fb39-45a1-b8c1-6e18a3b3c884 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:55.666261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 664/1347] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:10:55.671783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d415f2-4efe-44f2-88ac-d031c840813c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:55.672248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d415f2-4efe-44f2-88ac-d031c840813c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:55.672476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d415f2-4efe-44f2-88ac-d031c840813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:55.743674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-26d415f2-4efe-44f2-88ac-d031c840813c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:10:55.744889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-26d415f2-4efe-44f2-88ac-d031c840813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:55.840639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:55.843430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 684/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:10:56.126536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a817f3-fb39-45a1-b8c1-6e18a3b3c884 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:10:56.128146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-52a817f3-fb39-45a1-b8c1-6e18a3b3c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:56.232046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a817f3-fb39-45a1-b8c1-6e18a3b3c884 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:10:56.279872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:10:56.306209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d4344-180c-40ad-b79e-3acc99a80d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:10:56.306811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d4344-180c-40ad-b79e-3acc99a80d49 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:10:56.307122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d4344-180c-40ad-b79e-3acc99a80d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:10:56.307396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d4344-180c-40ad-b79e-3acc99a80d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:10:56.308989 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-311d4344-180c-40ad-b79e-3acc99a80d49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:10:56.417417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d4344-180c-40ad-b79e-3acc99a80d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:10:56.418760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d4344-180c-40ad-b79e-3acc99a80d49 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:10:56.437425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 665/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:01.369353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f010fb-2828-4f26-b92c-b60142cfe100 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:01.369858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f010fb-2828-4f26-b92c-b60142cfe100 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:01.369940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f010fb-2828-4f26-b92c-b60142cfe100 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:01.375081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 685/1350] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:11:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:01.383808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7632d4-8b7c-43bd-be80-5fdfa081c5f4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:01.383808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7632d4-8b7c-43bd-be80-5fdfa081c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:01.383808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7632d4-8b7c-43bd-be80-5fdfa081c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:01.470431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1e7632d4-8b7c-43bd-be80-5fdfa081c5f4 None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:01.471842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1e7632d4-8b7c-43bd-be80-5fdfa081c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:01.495611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:01.650471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 666/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:11:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:05.889374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e2d9-7fdd-401b-9ea6-e770a22e06da None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:05.890359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e2d9-7fdd-401b-9ea6-e770a22e06da None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:05.890712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e2d9-7fdd-401b-9ea6-e770a22e06da None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:05.892525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 686/1352] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:05.898001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09641d7-01d6-4267-9a31-ea92366951d0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:05.898478 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09641d7-01d6-4267-9a31-ea92366951d0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:05.898691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09641d7-01d6-4267-9a31-ea92366951d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:05.978622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f09641d7-01d6-4267-9a31-ea92366951d0 None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:05.979965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f09641d7-01d6-4267-9a31-ea92366951d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:06.054864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:06.093880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 667/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:11:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:07.428181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d23e-10d8-4e26-a468-8e71aa6ccfd8 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:07.428668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d23e-10d8-4e26-a468-8e71aa6ccfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:07.428668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27d23e-10d8-4e26-a468-8e71aa6ccfd8 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:07.430244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 687/1354] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:07.435631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ac46-2aeb-47b0-9d6a-49816353a48a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:07.436075 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ac46-2aeb-47b0-9d6a-49816353a48a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:07.436190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ac46-2aeb-47b0-9d6a-49816353a48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:07.515039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-af08ac46-2aeb-47b0-9d6a-49816353a48a None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:07.516250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-af08ac46-2aeb-47b0-9d6a-49816353a48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:07.624353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 668/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:11:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:11:11.207076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0672474-d9b7-47af-86a4-29aedce12a50 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:11.207675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0672474-d9b7-47af-86a4-29aedce12a50 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:11.207970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0672474-d9b7-47af-86a4-29aedce12a50 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:11.209919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 688/1356] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:11.215233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08ad6-a459-4b47-ab04-f1f88b5a7f7a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:11.215691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08ad6-a459-4b47-ab04-f1f88b5a7f7a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:11.215781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc08ad6-a459-4b47-ab04-f1f88b5a7f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:11.257526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:11.292304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3cc08ad6-a459-4b47-ab04-f1f88b5a7f7a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:11.293726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3cc08ad6-a459-4b47-ab04-f1f88b5a7f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:11.395957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 669/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:11:11.702013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fcada-2650-4a50-9439-caf277819dd9 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:11.702729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fcada-2650-4a50-9439-caf277819dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:11.703283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fcada-2650-4a50-9439-caf277819dd9 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:11.705150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 689/1358] 10.222.0.20 () {54 vars in 965 bytes} [Fri Sep 16 19:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:11.713823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7634d-b4d3-43df-922b-fcd3d15da11c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:11.714397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7634d-b4d3-43df-922b-fcd3d15da11c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:11.714911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7634d-b4d3-43df-922b-fcd3d15da11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:11.802955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-96d7634d-b4d3-43df-922b-fcd3d15da11c None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:11.804196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-96d7634d-b4d3-43df-922b-fcd3d15da11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:11.854684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:11.928667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 670/1359] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Sep 16 19:11:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:11:11.936234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fcada-2650-4a50-9439-caf277819dd9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:11.938033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a88fcada-2650-4a50-9439-caf277819dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:12.106541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fcada-2650-4a50-9439-caf277819dd9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:12.185462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:12.228860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f6eeb-789e-463b-bfa4-6dd171dc2eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:12.229491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6eeb-789e-463b-bfa4-6dd171dc2eaa service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:12.229735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6eeb-789e-463b-bfa4-6dd171dc2eaa service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:12.230006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f6eeb-789e-463b-bfa4-6dd171dc2eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:12.231638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-519f6eeb-789e-463b-bfa4-6dd171dc2eaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:12.332462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f6eeb-789e-463b-bfa4-6dd171dc2eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:12.334068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f6eeb-789e-463b-bfa4-6dd171dc2eaa service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:12.354661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 690/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:14.776133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aee27-9e17-4df3-86df-03d275f108de None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:14.776653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aee27-9e17-4df3-86df-03d275f108de None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:14.776653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3aee27-9e17-4df3-86df-03d275f108de None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:14.782701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 671/1361] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:14.783348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6a29-7a47-46e7-83e3-b844557ddb8f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:14.784012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6a29-7a47-46e7-83e3-b844557ddb8f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:14.784012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f6a29-7a47-46e7-83e3-b844557ddb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:14.853702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b29f6a29-7a47-46e7-83e3-b844557ddb8f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:14.858967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b29f6a29-7a47-46e7-83e3-b844557ddb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:14.900410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:14.964468 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 691/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:15.269059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aee27-9e17-4df3-86df-03d275f108de None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:15.271201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ac3aee27-9e17-4df3-86df-03d275f108de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:15.458561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3aee27-9e17-4df3-86df-03d275f108de None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:15.469815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:15.589602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a21d4-112b-4a11-99c4-7b67f913925a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:15.590214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a21d4-112b-4a11-99c4-7b67f913925a service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:15.590513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a21d4-112b-4a11-99c4-7b67f913925a service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:15.590773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a21d4-112b-4a11-99c4-7b67f913925a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:15.592686 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-238a21d4-112b-4a11-99c4-7b67f913925a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:15.688194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a21d4-112b-4a11-99c4-7b67f913925a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:15.689797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a21d4-112b-4a11-99c4-7b67f913925a service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:15.708515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 672/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:18.210036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c687c-c86b-4a54-a77f-2c3bb5a85e5b None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:18.210559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c687c-c86b-4a54-a77f-2c3bb5a85e5b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:18.210559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c687c-c86b-4a54-a77f-2c3bb5a85e5b None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:18.211969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 692/1364] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:18.217612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968714-ad63-4228-b30a-4a4da4e06bb4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:18.218022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968714-ad63-4228-b30a-4a4da4e06bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:18.218208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e968714-ad63-4228-b30a-4a4da4e06bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:18.233962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:18.291617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2e968714-ad63-4228-b30a-4a4da4e06bb4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:18.292854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2e968714-ad63-4228-b30a-4a4da4e06bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:18.395907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 673/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:18.688510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145e937-b520-4528-b87c-99c074399f23 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:18.689088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145e937-b520-4528-b87c-99c074399f23 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:18.689589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145e937-b520-4528-b87c-99c074399f23 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:18.691576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 693/1366] 10.222.0.20 () {54 vars in 965 bytes} [Fri Sep 16 19:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:18.697452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93464-c8e9-4807-9c50-f038af6427bf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:18.697964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93464-c8e9-4807-9c50-f038af6427bf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:18.698246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93464-c8e9-4807-9c50-f038af6427bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:18.777135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2ec93464-c8e9-4807-9c50-f038af6427bf None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:18.778332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2ec93464-c8e9-4807-9c50-f038af6427bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:18.814283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:18.902579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 674/1367] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Sep 16 19:11:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:18.910418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145e937-b520-4528-b87c-99c074399f23 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:18.911944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7145e937-b520-4528-b87c-99c074399f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:19.068292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145e937-b520-4528-b87c-99c074399f23 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:19.090708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:19.194453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab60b2-c9e9-4206-962f-7204282c05ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:19.195109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab60b2-c9e9-4206-962f-7204282c05ab service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:19.195392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab60b2-c9e9-4206-962f-7204282c05ab service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:19.195669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab60b2-c9e9-4206-962f-7204282c05ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:19.197251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-aeab60b2-c9e9-4206-962f-7204282c05ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:19.294062 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab60b2-c9e9-4206-962f-7204282c05ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:19.296797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab60b2-c9e9-4206-962f-7204282c05ab service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:19.316838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 694/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:19.451649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0923e-5014-4dd9-a42a-05ace2f78c63 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:19.452402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0923e-5014-4dd9-a42a-05ace2f78c63 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:19.452402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0923e-5014-4dd9-a42a-05ace2f78c63 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:19.453580 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 675/1369] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:19.460059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b3f4-75b0-4826-9feb-3dc7925f0915 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:19.460343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b3f4-75b0-4826-9feb-3dc7925f0915 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:19.460627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016b3f4-75b0-4826-9feb-3dc7925f0915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:19.498820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:19.544761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5016b3f4-75b0-4826-9feb-3dc7925f0915 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:19.546036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5016b3f4-75b0-4826-9feb-3dc7925f0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:19.663599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 695/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:20.002002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85401c-66b1-439d-9a90-916108a5c309 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:20.002002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85401c-66b1-439d-9a90-916108a5c309 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:20.002002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85401c-66b1-439d-9a90-916108a5c309 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:20.004505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 676/1371] 10.222.0.20 () {54 vars in 964 bytes} [Fri Sep 16 19:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:20.008532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b40c-36c7-407c-a76b-659af6eb26be None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:20.008825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b40c-36c7-407c-a76b-659af6eb26be None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:20.009106 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186b40c-36c7-407c-a76b-659af6eb26be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:20.090875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4186b40c-36c7-407c-a76b-659af6eb26be None None] MFA Rules not processed for user `1ef7ff56b97e4ca3af05cc407419d906`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:20.092936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4186b40c-36c7-407c-a76b-659af6eb26be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:20.145262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:20.176877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 696/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 16 19:11:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:20.185119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85401c-66b1-439d-9a90-916108a5c309 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:20.186671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-dc85401c-66b1-439d-9a90-916108a5c309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:20.300055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85401c-66b1-439d-9a90-916108a5c309 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:20.343918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:20.384076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b150b-44c5-4fb9-b9d0-3872719342a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:20.384699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b150b-44c5-4fb9-b9d0-3872719342a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:20.384987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b150b-44c5-4fb9-b9d0-3872719342a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:20.385264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b150b-44c5-4fb9-b9d0-3872719342a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:20.386873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-252b150b-44c5-4fb9-b9d0-3872719342a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:20.521715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b150b-44c5-4fb9-b9d0-3872719342a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:20.523789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b150b-44c5-4fb9-b9d0-3872719342a3 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:20.544927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 677/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:21.574056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f6b7-f1a9-449e-9d99-b2d4b4530d6b None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:21.574590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f6b7-f1a9-449e-9d99-b2d4b4530d6b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:21.574590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f6b7-f1a9-449e-9d99-b2d4b4530d6b None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:21.575993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 697/1374] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:21.581969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444cc9d-7db6-4c0a-aa3e-ef18acbf495c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:21.582374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444cc9d-7db6-4c0a-aa3e-ef18acbf495c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:21.582547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444cc9d-7db6-4c0a-aa3e-ef18acbf495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:21.649419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2444cc9d-7db6-4c0a-aa3e-ef18acbf495c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:21.651194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2444cc9d-7db6-4c0a-aa3e-ef18acbf495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:21.671870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:21.748852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 678/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:22.048841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f6b7-f1a9-449e-9d99-b2d4b4530d6b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:22.050699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a5e3f6b7-f1a9-449e-9d99-b2d4b4530d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:22.218051 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f6b7-f1a9-449e-9d99-b2d4b4530d6b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:22.273838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:22.342578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c3de2-d78c-4935-a52a-810fb80ce135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:22.343248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3de2-d78c-4935-a52a-810fb80ce135 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:22.343533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3de2-d78c-4935-a52a-810fb80ce135 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:22.343806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3de2-d78c-4935-a52a-810fb80ce135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:22.345406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-173c3de2-d78c-4935-a52a-810fb80ce135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:22.446742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c3de2-d78c-4935-a52a-810fb80ce135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:22.446742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c3de2-d78c-4935-a52a-810fb80ce135 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:22.464036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 698/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:24.680602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0698-3fb5-407a-95e0-d76af0a48223 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:24.681148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0698-3fb5-407a-95e0-d76af0a48223 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:24.681148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d0698-3fb5-407a-95e0-d76af0a48223 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:24.682643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 679/1377] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:24.687928 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c2ea-db88-4d4f-8a8f-9c21545f0a8b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:24.688330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c2ea-db88-4d4f-8a8f-9c21545f0a8b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:24.688520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c2ea-db88-4d4f-8a8f-9c21545f0a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:24.759170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7540c2ea-db88-4d4f-8a8f-9c21545f0a8b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:24.760391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7540c2ea-db88-4d4f-8a8f-9c21545f0a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:24.768394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:24.875083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 699/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:25.173460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d0698-3fb5-407a-95e0-d76af0a48223 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:25.175054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f26d0698-3fb5-407a-95e0-d76af0a48223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:25.329044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d0698-3fb5-407a-95e0-d76af0a48223 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:25.333459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:25.454208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c214-4652-4517-8cda-0ac9c9fdfb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:25.454860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c214-4652-4517-8cda-0ac9c9fdfb88 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:25.455326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c214-4652-4517-8cda-0ac9c9fdfb88 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:25.455612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c214-4652-4517-8cda-0ac9c9fdfb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:25.457229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bf38c214-4652-4517-8cda-0ac9c9fdfb88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:25.557128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c214-4652-4517-8cda-0ac9c9fdfb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:25.558736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c214-4652-4517-8cda-0ac9c9fdfb88 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:25.578632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 680/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:28.105302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b6d57-59c4-463d-a9da-7576d7dd7628 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:28.106206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b6d57-59c4-463d-a9da-7576d7dd7628 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:28.106206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b6d57-59c4-463d-a9da-7576d7dd7628 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:28.107629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 700/1380] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:28.115781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b4d1a-8808-4d9f-8525-af9354e12701 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:28.115781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b4d1a-8808-4d9f-8525-af9354e12701 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:28.116896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b4d1a-8808-4d9f-8525-af9354e12701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:28.140351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:28.258507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-335b4d1a-8808-4d9f-8525-af9354e12701 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:28.259805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-335b4d1a-8808-4d9f-8525-af9354e12701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:28.371656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 681/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:28.730519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b6d57-59c4-463d-a9da-7576d7dd7628 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:28.733679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-549b6d57-59c4-463d-a9da-7576d7dd7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:28.898955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:28.910841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b6d57-59c4-463d-a9da-7576d7dd7628 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:29.041768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a376d92-b354-42fc-9f1b-ac24c254597e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:29.042419 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376d92-b354-42fc-9f1b-ac24c254597e service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:29.042758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376d92-b354-42fc-9f1b-ac24c254597e service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:29.043174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a376d92-b354-42fc-9f1b-ac24c254597e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:29.045000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8a376d92-b354-42fc-9f1b-ac24c254597e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:29.141601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a376d92-b354-42fc-9f1b-ac24c254597e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:29.143376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a376d92-b354-42fc-9f1b-ac24c254597e service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:29.153913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:29.163497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 701/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:31.512183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013226-201f-40c1-81bb-bf86800acd9b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:31.512713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013226-201f-40c1-81bb-bf86800acd9b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:31.512809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d013226-201f-40c1-81bb-bf86800acd9b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:31.514100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 682/1383] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:31.520198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09fec-c3af-47c1-9041-113f4f832079 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:31.520830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09fec-c3af-47c1-9041-113f4f832079 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:31.520830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d09fec-c3af-47c1-9041-113f4f832079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:31.590324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-50d09fec-c3af-47c1-9041-113f4f832079 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:31.591618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-50d09fec-c3af-47c1-9041-113f4f832079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:31.717999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 702/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:32.124285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d013226-201f-40c1-81bb-bf86800acd9b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:32.126307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3d013226-201f-40c1-81bb-bf86800acd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:32.228104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:32.293018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d013226-201f-40c1-81bb-bf86800acd9b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:32.425685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a07be-ee0e-4a4c-8bbe-b3826f93bfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:32.426311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a07be-ee0e-4a4c-8bbe-b3826f93bfbc service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:32.426602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a07be-ee0e-4a4c-8bbe-b3826f93bfbc service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:32.426876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a07be-ee0e-4a4c-8bbe-b3826f93bfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:32.428559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-de5a07be-ee0e-4a4c-8bbe-b3826f93bfbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:32.491418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:32.535926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a07be-ee0e-4a4c-8bbe-b3826f93bfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:32.537565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a07be-ee0e-4a4c-8bbe-b3826f93bfbc service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:32.557477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 683/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:34.733020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a346ad-dcb6-45f2-a9c7-699ea53ab957 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:34.733601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a346ad-dcb6-45f2-a9c7-699ea53ab957 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:34.733601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a346ad-dcb6-45f2-a9c7-699ea53ab957 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:34.734929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 703/1386] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:34.740583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37dcdb-b21b-4d9d-b287-0708c8898fd1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:34.741175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37dcdb-b21b-4d9d-b287-0708c8898fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:34.741175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37dcdb-b21b-4d9d-b287-0708c8898fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:34.809209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bd37dcdb-b21b-4d9d-b287-0708c8898fd1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:34.810434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bd37dcdb-b21b-4d9d-b287-0708c8898fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:34.910762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 684/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:35.207918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a346ad-dcb6-45f2-a9c7-699ea53ab957 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:35.209448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-90a346ad-dcb6-45f2-a9c7-699ea53ab957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:35.291575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:35.383884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a346ad-dcb6-45f2-a9c7-699ea53ab957 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:35.516541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87081030-8042-43c1-af06-51f372da0e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:35.517189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081030-8042-43c1-af06-51f372da0e5d service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:35.517963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081030-8042-43c1-af06-51f372da0e5d service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:35.518241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87081030-8042-43c1-af06-51f372da0e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:35.519897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-87081030-8042-43c1-af06-51f372da0e5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:35.563408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:35.624979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081030-8042-43c1-af06-51f372da0e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:35.628030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87081030-8042-43c1-af06-51f372da0e5d service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:35.651635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 704/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:37.986867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad545dc-8128-4405-a061-c285ff60aaef None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:37.987564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad545dc-8128-4405-a061-c285ff60aaef None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:37.987564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad545dc-8128-4405-a061-c285ff60aaef None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:37.988826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 685/1389] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:37.994117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d04ed-2915-4a0d-a3f7-79552aab1c76 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:37.994575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d04ed-2915-4a0d-a3f7-79552aab1c76 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:37.994693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb799de-f99f-45d0-bdd4-ee03db4d80e3 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:37.994792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d04ed-2915-4a0d-a3f7-79552aab1c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:37.994884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb799de-f99f-45d0-bdd4-ee03db4d80e3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:37.995119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb799de-f99f-45d0-bdd4-ee03db4d80e3 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:37.996373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 686/1390] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:11:38.001339 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdfd7e-7855-4ef7-a88e-5c60afb5bfe0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:38.002234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdfd7e-7855-4ef7-a88e-5c60afb5bfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:38.002687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccdfd7e-7855-4ef7-a88e-5c60afb5bfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:38.038292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:38.063227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8b8d04ed-2915-4a0d-a3f7-79552aab1c76 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:38.064998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8b8d04ed-2915-4a0d-a3f7-79552aab1c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:38.073354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8ccdfd7e-7855-4ef7-a88e-5c60afb5bfe0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:38.074545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8ccdfd7e-7855-4ef7-a88e-5c60afb5bfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:38.167012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 705/1391] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:38.171211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 687/1392] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:11:38.472748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8352d-52e6-4241-90d2-bcbeb6d5b89a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:38.473036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8352d-52e6-4241-90d2-bcbeb6d5b89a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:38.473315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8352d-52e6-4241-90d2-bcbeb6d5b89a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:38.474678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 706/1393] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 16 19:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:38.476911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdfd7e-7855-4ef7-a88e-5c60afb5bfe0 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:38.478219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8ccdfd7e-7855-4ef7-a88e-5c60afb5bfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:38.479678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19542d-85f3-4f1f-b491-cb87f88896a8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:38.479962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19542d-85f3-4f1f-b491-cb87f88896a8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:38.480243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19542d-85f3-4f1f-b491-cb87f88896a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:38.496707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:38.564673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cc19542d-85f3-4f1f-b491-cb87f88896a8 None None] MFA Rules not processed for user `a909fc6177e94d2fa6d38dad285e616a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:38.566313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cc19542d-85f3-4f1f-b491-cb87f88896a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:38.609447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:38.619643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccdfd7e-7855-4ef7-a88e-5c60afb5bfe0 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:38.644264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 707/1394] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 16 19:11:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:11:38.653666 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19542d-85f3-4f1f-b491-cb87f88896a8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:38.661503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19542d-85f3-4f1f-b491-cb87f88896a8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:38.737466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee4e16-7b5d-4178-b641-4f90fa325cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:38.738076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee4e16-7b5d-4178-b641-4f90fa325cd5 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:38.738351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee4e16-7b5d-4178-b641-4f90fa325cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:38.738620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee4e16-7b5d-4178-b641-4f90fa325cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:38.738931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd9d53-279e-43a5-b92f-d53284c34672 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a909fc6177e94d2fa6d38dad285e616a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:38.739561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9d53-279e-43a5-b92f-d53284c34672 service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:38.739839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9d53-279e-43a5-b92f-d53284c34672 service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:38.740110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9d53-279e-43a5-b92f-d53284c34672 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:38.740269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-46ee4e16-7b5d-4178-b641-4f90fa325cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:38.741661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-19cd9d53-279e-43a5-b92f-d53284c34672 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:38.771980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:38.832565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee4e16-7b5d-4178-b641-4f90fa325cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:38.834165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee4e16-7b5d-4178-b641-4f90fa325cd5 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:38.850452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:38.853765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 688/1395] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:38.855404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd9d53-279e-43a5-b92f-d53284c34672 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:38.856883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd9d53-279e-43a5-b92f-d53284c34672 service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:38.877025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 708/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:11:39.624135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9559-9278-4244-a635-8fa6373282d0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:39.624624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9559-9278-4244-a635-8fa6373282d0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:39.624858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b9559-9278-4244-a635-8fa6373282d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:39.692695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b54b9559-9278-4244-a635-8fa6373282d0 None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:39.693826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b54b9559-9278-4244-a635-8fa6373282d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:39.783579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 689/1397] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:11:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:39.826433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247aec-1b66-488a-9ab1-f73edf9623e3 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:39.826935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247aec-1b66-488a-9ab1-f73edf9623e3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:39.827077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247aec-1b66-488a-9ab1-f73edf9623e3 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:39.828380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 709/1398] 10.222.0.20 () {54 vars in 943 bytes} [Fri Sep 16 19:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:39.835656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aedef-25a6-47ed-8ec7-4deeadd7c654 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:39.835945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aedef-25a6-47ed-8ec7-4deeadd7c654 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:39.836222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299aedef-25a6-47ed-8ec7-4deeadd7c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:39.916149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-299aedef-25a6-47ed-8ec7-4deeadd7c654 None None] MFA Rules not processed for user `778fb2fe04a242a0a7e4b5b062fc0775`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:39.917349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-299aedef-25a6-47ed-8ec7-4deeadd7c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:39.951222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:40.025608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 690/1399] 10.222.0.20 () {58 vars in 1040 bytes} [Fri Sep 16 19:11:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:11:40.035688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247aec-1b66-488a-9ab1-f73edf9623e3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:40.037187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d2247aec-1b66-488a-9ab1-f73edf9623e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:40.174291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:40.176851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247aec-1b66-488a-9ab1-f73edf9623e3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:40.283036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5d7b6-b460-404c-8d22-69a9b2bee19c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:40.283898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d7b6-b460-404c-8d22-69a9b2bee19c service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:40.284177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d7b6-b460-404c-8d22-69a9b2bee19c service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:40.284449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5d7b6-b460-404c-8d22-69a9b2bee19c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:40.286065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ddd5d7b6-b460-404c-8d22-69a9b2bee19c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:40.368971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5d7b6-b460-404c-8d22-69a9b2bee19c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:40.370576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5d7b6-b460-404c-8d22-69a9b2bee19c service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:40.379676 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 710/1400] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:11:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:11:41.096966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de98a11-fb13-4fe7-ad3a-f5e620816faf None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:41.096966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de98a11-fb13-4fe7-ad3a-f5e620816faf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:41.096966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de98a11-fb13-4fe7-ad3a-f5e620816faf None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:41.098082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 691/1401] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:41.103870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b127397-77b1-4222-a5f8-79d60557041f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:41.104696 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b127397-77b1-4222-a5f8-79d60557041f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:41.105044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b127397-77b1-4222-a5f8-79d60557041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:41.144655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:41.179487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2b127397-77b1-4222-a5f8-79d60557041f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:41.181006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2b127397-77b1-4222-a5f8-79d60557041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:41.302723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 711/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:41.613632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de98a11-fb13-4fe7-ad3a-f5e620816faf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:41.615410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5de98a11-fb13-4fe7-ad3a-f5e620816faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:41.795965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de98a11-fb13-4fe7-ad3a-f5e620816faf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:41.800133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:41.926002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963d217-e9b4-424c-b56e-d17702ec77c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:41.926525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d217-e9b4-424c-b56e-d17702ec77c7 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:41.926799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d217-e9b4-424c-b56e-d17702ec77c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:41.927096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d217-e9b4-424c-b56e-d17702ec77c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:41.928682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5963d217-e9b4-424c-b56e-d17702ec77c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:42.037309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963d217-e9b4-424c-b56e-d17702ec77c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:42.038938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963d217-e9b4-424c-b56e-d17702ec77c7 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:42.059209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 692/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:44.282221 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a504d4-d78a-450c-ad20-66f4e050ff27 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:44.282756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a504d4-d78a-450c-ad20-66f4e050ff27 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:44.282756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a504d4-d78a-450c-ad20-66f4e050ff27 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:44.284432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 712/1404] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:44.289805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc1432-696d-467c-9da4-4641ef188836 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:44.290289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc1432-696d-467c-9da4-4641ef188836 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:44.290373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc1432-696d-467c-9da4-4641ef188836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:44.302440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:44.366110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2fcc1432-696d-467c-9da4-4641ef188836 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:44.367362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2fcc1432-696d-467c-9da4-4641ef188836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:44.479471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 693/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:44.776693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a504d4-d78a-450c-ad20-66f4e050ff27 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:44.778434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f8a504d4-d78a-450c-ad20-66f4e050ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:44.902368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:44.955483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a504d4-d78a-450c-ad20-66f4e050ff27 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:45.077941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23b46-104a-416a-ab33-20510df996de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:45.078718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23b46-104a-416a-ab33-20510df996de service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:45.079042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23b46-104a-416a-ab33-20510df996de service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:45.079327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23b46-104a-416a-ab33-20510df996de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:45.081220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3fe23b46-104a-416a-ab33-20510df996de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:45.172051 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:45.191677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23b46-104a-416a-ab33-20510df996de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:45.193609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23b46-104a-416a-ab33-20510df996de service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:45.215679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 713/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:47.445990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85bdd1-1900-4f4b-9bf8-89d15ccfeb57 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:47.446408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85bdd1-1900-4f4b-9bf8-89d15ccfeb57 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:47.446556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85bdd1-1900-4f4b-9bf8-89d15ccfeb57 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:47.448112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 694/1407] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:11:47.453285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17bd2a-fb7b-4398-b78d-760c009113db None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:47.453702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17bd2a-fb7b-4398-b78d-760c009113db None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:47.453844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17bd2a-fb7b-4398-b78d-760c009113db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:47.525048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ab17bd2a-fb7b-4398-b78d-760c009113db None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:11:47.526310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ab17bd2a-fb7b-4398-b78d-760c009113db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:47.637855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 714/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:11:47.925273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85bdd1-1900-4f4b-9bf8-89d15ccfeb57 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:11:47.926792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-df85bdd1-1900-4f4b-9bf8-89d15ccfeb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:48.030647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:48.100790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85bdd1-1900-4f4b-9bf8-89d15ccfeb57 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:11:48.227936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a26b5-be32-4674-b347-be2f0104701e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:11:48.228549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a26b5-be32-4674-b347-be2f0104701e service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:11:48.228828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a26b5-be32-4674-b347-be2f0104701e service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:11:48.229102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a26b5-be32-4674-b347-be2f0104701e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:11:48.230916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-111a26b5-be32-4674-b347-be2f0104701e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:11:48.289092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:48.333050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a26b5-be32-4674-b347-be2f0104701e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:11:48.334756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a26b5-be32-4674-b347-be2f0104701e service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:11:48.358162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 695/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:11:57.636296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=79 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:11:58.355162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=23 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:03.392960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6ede9-f3be-45f2-b1a9-6f4e5cfd17cf None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:03.393712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6ede9-f3be-45f2-b1a9-6f4e5cfd17cf None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:03.393712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6ede9-f3be-45f2-b1a9-6f4e5cfd17cf None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:03.394808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 715/1410] 10.222.0.20 () {54 vars in 918 bytes} [Fri Sep 16 19:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:03.399786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76051913-bdd5-47c0-a62f-88fb376a2b3b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:03.400238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76051913-bdd5-47c0-a62f-88fb376a2b3b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:03.400347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76051913-bdd5-47c0-a62f-88fb376a2b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:03.480997 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-76051913-bdd5-47c0-a62f-88fb376a2b3b None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:03.482217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-76051913-bdd5-47c0-a62f-88fb376a2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:03.585876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 696/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 16 19:12:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:03.601158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3392e-8193-4889-9252-748b7b35553e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:03.601444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3392e-8193-4889-9252-748b7b35553e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:03.601725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3392e-8193-4889-9252-748b7b35553e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:03.603087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 716/1412] 10.222.0.20 () {54 vars in 918 bytes} [Fri Sep 16 19:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:03.607658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234a6d-ae12-4910-92a8-04f6f40002a0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:03.607940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234a6d-ae12-4910-92a8-04f6f40002a0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:03.608215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234a6d-ae12-4910-92a8-04f6f40002a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:03.680526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:03.683328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d0234a6d-ae12-4910-92a8-04f6f40002a0 None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:03.685064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d0234a6d-ae12-4910-92a8-04f6f40002a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:03.799306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 697/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 16 19:12:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:06.362528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7cbe-c0c1-4429-83c0-2422d32f8122 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:06.363117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7cbe-c0c1-4429-83c0-2422d32f8122 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:06.363117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac7cbe-c0c1-4429-83c0-2422d32f8122 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:06.364497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:06.369875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0043-f0e2-4338-bc82-1af9a652fcfb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:06.370284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0043-f0e2-4338-bc82-1af9a652fcfb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:06.370433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d0043-f0e2-4338-bc82-1af9a652fcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:06.437871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f85d0043-f0e2-4338-bc82-1af9a652fcfb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:06.439108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f85d0043-f0e2-4338-bc82-1af9a652fcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:06.494853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:06.536562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:06.832299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7cbe-c0c1-4429-83c0-2422d32f8122 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:06.834561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b1ac7cbe-c0c1-4429-83c0-2422d32f8122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:06.979187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac7cbe-c0c1-4429-83c0-2422d32f8122 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:07.051462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:07.092168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932e8fd-533b-4862-9035-f8878950bd71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:07.092707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e8fd-533b-4862-9035-f8878950bd71 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:07.092994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e8fd-533b-4862-9035-f8878950bd71 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:07.093268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932e8fd-533b-4862-9035-f8878950bd71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:07.095146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e932e8fd-533b-4862-9035-f8878950bd71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:07.185884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932e8fd-533b-4862-9035-f8878950bd71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:07.187507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e932e8fd-533b-4862-9035-f8878950bd71 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:07.205730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 718/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:08.352505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5490-a560-474f-ae22-c3ab42f0ed65 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:08.353069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5490-a560-474f-ae22-c3ab42f0ed65 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:08.353069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e5490-a560-474f-ae22-c3ab42f0ed65 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:08.354410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:08.360549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46780c11-f6fc-4ef4-9928-b3949a4ef0a8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:08.360974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46780c11-f6fc-4ef4-9928-b3949a4ef0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:08.361100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46780c11-f6fc-4ef4-9928-b3949a4ef0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:08.436789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-46780c11-f6fc-4ef4-9928-b3949a4ef0a8 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:08.438010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-46780c11-f6fc-4ef4-9928-b3949a4ef0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:08.466112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:08.536661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:08.689560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e5490-a560-474f-ae22-c3ab42f0ed65 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:08.691190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-434e5490-a560-474f-ae22-c3ab42f0ed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:08.837058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e5490-a560-474f-ae22-c3ab42f0ed65 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:08.878120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:08.951622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a580ae4-06bb-4b01-8b12-9ce43edc3750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:08.952231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580ae4-06bb-4b01-8b12-9ce43edc3750 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:08.952513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580ae4-06bb-4b01-8b12-9ce43edc3750 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:08.952789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a580ae4-06bb-4b01-8b12-9ce43edc3750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:08.954393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2a580ae4-06bb-4b01-8b12-9ce43edc3750 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:09.043404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a580ae4-06bb-4b01-8b12-9ce43edc3750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:09.044993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a580ae4-06bb-4b01-8b12-9ce43edc3750 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:09.063324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 700/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:10.197727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596f85-af45-4d93-896a-df7513b0b1c6 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:10.198278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596f85-af45-4d93-896a-df7513b0b1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:10.198278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09596f85-af45-4d93-896a-df7513b0b1c6 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:10.199679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:10.206368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743fca-94fb-4454-872f-781e7fcc7d89 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:10.206818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743fca-94fb-4454-872f-781e7fcc7d89 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:10.206924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c743fca-94fb-4454-872f-781e7fcc7d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:10.260589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:10.284552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5c743fca-94fb-4454-872f-781e7fcc7d89 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:10.285767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5c743fca-94fb-4454-872f-781e7fcc7d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:10.381180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:10.534112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09596f85-af45-4d93-896a-df7513b0b1c6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:10.535577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-09596f85-af45-4d93-896a-df7513b0b1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:10.683220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09596f85-af45-4d93-896a-df7513b0b1c6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:10.695730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:10.798001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac14728-14da-483e-8448-590b5a73b27c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:10.798519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac14728-14da-483e-8448-590b5a73b27c service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:10.798851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac14728-14da-483e-8448-590b5a73b27c service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:10.799153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac14728-14da-483e-8448-590b5a73b27c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:10.800727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fac14728-14da-483e-8448-590b5a73b27c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:10.890179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac14728-14da-483e-8448-590b5a73b27c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:10.891809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac14728-14da-483e-8448-590b5a73b27c service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:10.910350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 721/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:12.038756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7a0c-63de-4e79-951e-3699590b9524 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:12.039278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7a0c-63de-4e79-951e-3699590b9524 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:12.039390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb7a0c-63de-4e79-951e-3699590b9524 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:12.040789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:12.047027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c51a92-2789-4913-94bb-bf6ffda9feb3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:12.047456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c51a92-2789-4913-94bb-bf6ffda9feb3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:12.047580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c51a92-2789-4913-94bb-bf6ffda9feb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:12.068156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:12.125024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-05c51a92-2789-4913-94bb-bf6ffda9feb3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:12.126240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-05c51a92-2789-4913-94bb-bf6ffda9feb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:12.222771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:12.373311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7a0c-63de-4e79-951e-3699590b9524 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:12.374884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a6fb7a0c-63de-4e79-951e-3699590b9524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:12.485998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:12.523286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb7a0c-63de-4e79-951e-3699590b9524 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:12.636277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d230c9-b8b0-4bb8-b58f-0ffe3b586ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:12.636866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d230c9-b8b0-4bb8-b58f-0ffe3b586ad4 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:12.637142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d230c9-b8b0-4bb8-b58f-0ffe3b586ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:12.637410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d230c9-b8b0-4bb8-b58f-0ffe3b586ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:12.638986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-34d230c9-b8b0-4bb8-b58f-0ffe3b586ad4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:12.714740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:12.728806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d230c9-b8b0-4bb8-b58f-0ffe3b586ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:12.730402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d230c9-b8b0-4bb8-b58f-0ffe3b586ad4 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:12.749142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 703/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:13.862624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b73f-b684-4795-be41-1d7fa955b7e2 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:13.863228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b73f-b684-4795-be41-1d7fa955b7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:13.863228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73b73f-b684-4795-be41-1d7fa955b7e2 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:13.864569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:13.870944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e1c6-de12-46a3-a42e-aab9eb56afa9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:13.871436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e1c6-de12-46a3-a42e-aab9eb56afa9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:13.871542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707e1c6-de12-46a3-a42e-aab9eb56afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:14.063217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7707e1c6-de12-46a3-a42e-aab9eb56afa9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:14.064505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7707e1c6-de12-46a3-a42e-aab9eb56afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:14.162570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:14.311889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73b73f-b684-4795-be41-1d7fa955b7e2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:14.313566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2e73b73f-b684-4795-be41-1d7fa955b7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:14.398367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:14.462929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73b73f-b684-4795-be41-1d7fa955b7e2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:14.576406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3a404-ee80-4b49-b460-442bde45df97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:14.577010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a404-ee80-4b49-b460-442bde45df97 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:14.577288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a404-ee80-4b49-b460-442bde45df97 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:14.577558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3a404-ee80-4b49-b460-442bde45df97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:14.579176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c7b3a404-ee80-4b49-b460-442bde45df97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:14.630347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:14.671348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3a404-ee80-4b49-b460-442bde45df97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:14.673000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3a404-ee80-4b49-b460-442bde45df97 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:14.692028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 724/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:15.745315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff0301-959c-4728-a6a7-ffa86c6d7ca1 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:15.745843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff0301-959c-4728-a6a7-ffa86c6d7ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:15.745843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff0301-959c-4728-a6a7-ffa86c6d7ca1 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:15.747279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:15.754333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42145c-c927-4f33-b468-bd249ec6b936 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:15.754775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42145c-c927-4f33-b468-bd249ec6b936 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:15.754879 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42145c-c927-4f33-b468-bd249ec6b936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:15.829731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1b42145c-c927-4f33-b468-bd249ec6b936 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:15.831086 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1b42145c-c927-4f33-b468-bd249ec6b936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:15.927077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:16.075219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff0301-959c-4728-a6a7-ffa86c6d7ca1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:16.076671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-91ff0301-959c-4728-a6a7-ffa86c6d7ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:16.126837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:16.229326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff0301-959c-4728-a6a7-ffa86c6d7ca1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:16.346554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096c4a1-2f3f-4dd1-8d4d-a7e5948249bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:16.347114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c4a1-2f3f-4dd1-8d4d-a7e5948249bf service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:16.347396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c4a1-2f3f-4dd1-8d4d-a7e5948249bf service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:16.347671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096c4a1-2f3f-4dd1-8d4d-a7e5948249bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:16.349281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3096c4a1-2f3f-4dd1-8d4d-a7e5948249bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:16.356178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:16.438509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096c4a1-2f3f-4dd1-8d4d-a7e5948249bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:16.440479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096c4a1-2f3f-4dd1-8d4d-a7e5948249bf service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:16.458805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 706/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:17.510080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0674d-48fb-4e49-80ef-c7cd1e18354e None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:17.510609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0674d-48fb-4e49-80ef-c7cd1e18354e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:17.510609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0674d-48fb-4e49-80ef-c7cd1e18354e None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:17.512031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:17.518295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68553be-9fae-466c-a35a-30982d278863 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:17.518740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68553be-9fae-466c-a35a-30982d278863 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:17.518847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68553be-9fae-466c-a35a-30982d278863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:17.596960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b68553be-9fae-466c-a35a-30982d278863 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:17.598165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b68553be-9fae-466c-a35a-30982d278863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:17.665764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:17.694142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:17.844942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0674d-48fb-4e49-80ef-c7cd1e18354e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:17.847107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7cd0674d-48fb-4e49-80ef-c7cd1e18354e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:17.864535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:17.991902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0674d-48fb-4e49-80ef-c7cd1e18354e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:18.079363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:18.106914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4888edb-4ea9-4ef2-a4de-f6c4ce88df4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:18.107547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888edb-4ea9-4ef2-a4de-f6c4ce88df4d service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:18.107825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888edb-4ea9-4ef2-a4de-f6c4ce88df4d service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:18.108095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888edb-4ea9-4ef2-a4de-f6c4ce88df4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:18.109689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f4888edb-4ea9-4ef2-a4de-f6c4ce88df4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:18.198396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4888edb-4ea9-4ef2-a4de-f6c4ce88df4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:18.200015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4888edb-4ea9-4ef2-a4de-f6c4ce88df4d service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:18.217719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 727/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:12:19.271870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81dc2-19c4-4ce5-a339-609a0b2eae38 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:19.272392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81dc2-19c4-4ce5-a339-609a0b2eae38 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:19.272504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81dc2-19c4-4ce5-a339-609a0b2eae38 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:19.273755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:19.280092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7f4b-0d74-4cc8-b112-9e1da388ff0d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:19.280504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7f4b-0d74-4cc8-b112-9e1da388ff0d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:19.280678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad7f4b-0d74-4cc8-b112-9e1da388ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:19.356885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-37ad7f4b-0d74-4cc8-b112-9e1da388ff0d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:19.358108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-37ad7f4b-0d74-4cc8-b112-9e1da388ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:19.400861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:19.455641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:19.607330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce81dc2-19c4-4ce5-a339-609a0b2eae38 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:19.608858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7ce81dc2-19c4-4ce5-a339-609a0b2eae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:19.753621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce81dc2-19c4-4ce5-a339-609a0b2eae38 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:19.806762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:19.866256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a6ba-83ca-4399-95b8-508527c9310b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:19.866865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a6ba-83ca-4399-95b8-508527c9310b service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:19.867188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a6ba-83ca-4399-95b8-508527c9310b service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:19.867467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a6ba-83ca-4399-95b8-508527c9310b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:19.869181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3aa4a6ba-83ca-4399-95b8-508527c9310b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:19.959853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a6ba-83ca-4399-95b8-508527c9310b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:19.961423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a6ba-83ca-4399-95b8-508527c9310b service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:19.979161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 709/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:12:21.041240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c4422-ccf2-4e52-8968-4f80810e35ea None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:21.041810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c4422-ccf2-4e52-8968-4f80810e35ea None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:21.041810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c4422-ccf2-4e52-8968-4f80810e35ea None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:21.043254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:21.049894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb39060-bba6-475d-84c0-50bb3f09eca3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:21.050364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb39060-bba6-475d-84c0-50bb3f09eca3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:21.050552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb39060-bba6-475d-84c0-50bb3f09eca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:21.126263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cdb39060-bba6-475d-84c0-50bb3f09eca3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:21.128051 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cdb39060-bba6-475d-84c0-50bb3f09eca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:21.130076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:21.224249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:21.374316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c4422-ccf2-4e52-8968-4f80810e35ea None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:21.375792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-099c4422-ccf2-4e52-8968-4f80810e35ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:21.522169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c4422-ccf2-4e52-8968-4f80810e35ea None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:21.550306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:21.639742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a3d2c-f5d8-42f7-85b4-763375e93ffb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:21.640617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3d2c-f5d8-42f7-85b4-763375e93ffb service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:21.640617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3d2c-f5d8-42f7-85b4-763375e93ffb service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:21.640915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a3d2c-f5d8-42f7-85b4-763375e93ffb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:21.643240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ee1a3d2c-f5d8-42f7-85b4-763375e93ffb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:21.733817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3d2c-f5d8-42f7-85b4-763375e93ffb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:21.735437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a3d2c-f5d8-42f7-85b4-763375e93ffb service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:21.754476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 730/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:23.833186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6fa6-3928-479b-8da6-27401200ca7d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:23.833818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6fa6-3928-479b-8da6-27401200ca7d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:23.833818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa6fa6-3928-479b-8da6-27401200ca7d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.835111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:23.840482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ac1c-a98b-429f-8eec-67e4e5abc2dd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:23.840914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ac1c-a98b-429f-8eec-67e4e5abc2dd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:23.841078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ac1c-a98b-429f-8eec-67e4e5abc2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:23.882370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:23.907246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8cd1ac1c-a98b-429f-8eec-67e4e5abc2dd None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:23.908551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8cd1ac1c-a98b-429f-8eec-67e4e5abc2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:24.004323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:24.292001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6fa6-3928-479b-8da6-27401200ca7d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:24.293531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-68aa6fa6-3928-479b-8da6-27401200ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:24.397087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa6fa6-3928-479b-8da6-27401200ca7d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:24.429628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:24.472142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeb507-72f5-4718-a135-3f2cc3b88695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:24.472750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb507-72f5-4718-a135-3f2cc3b88695 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:24.473031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb507-72f5-4718-a135-3f2cc3b88695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:24.473304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeb507-72f5-4718-a135-3f2cc3b88695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:24.474910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-11aeb507-72f5-4718-a135-3f2cc3b88695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:24.583769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeb507-72f5-4718-a135-3f2cc3b88695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:24.585105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeb507-72f5-4718-a135-3f2cc3b88695 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:24.604218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 712/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:26.901183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c62999-4b4d-45d2-b55b-d47133fc4204 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:26.901745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c62999-4b4d-45d2-b55b-d47133fc4204 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:26.901745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c62999-4b4d-45d2-b55b-d47133fc4204 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:26.903108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:26.908501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f478-539c-4f3d-9266-e8e1f82e0459 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:26.908928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f478-539c-4f3d-9266-e8e1f82e0459 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:26.909073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312f478-539c-4f3d-9266-e8e1f82e0459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:26.975562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f312f478-539c-4f3d-9266-e8e1f82e0459 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:26.976773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f312f478-539c-4f3d-9266-e8e1f82e0459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:26.989496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:27.073305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:27.362285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c62999-4b4d-45d2-b55b-d47133fc4204 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:27.363878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d8c62999-4b4d-45d2-b55b-d47133fc4204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:27.468986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c62999-4b4d-45d2-b55b-d47133fc4204 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:27.482318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:27.543987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff05f8b-d46c-4205-a819-3c98a5b17914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:27.544585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05f8b-d46c-4205-a819-3c98a5b17914 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:27.544862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05f8b-d46c-4205-a819-3c98a5b17914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:27.545131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05f8b-d46c-4205-a819-3c98a5b17914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:27.546717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-aff05f8b-d46c-4205-a819-3c98a5b17914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:27.657672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff05f8b-d46c-4205-a819-3c98a5b17914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:27.659302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff05f8b-d46c-4205-a819-3c98a5b17914 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:27.677719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 733/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:30.230915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711e8d4-015f-4e62-b439-bfa740d2254d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:30.231502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711e8d4-015f-4e62-b439-bfa740d2254d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:30.231502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711e8d4-015f-4e62-b439-bfa740d2254d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:30.232926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:30.238948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830da4d-8bff-46db-b627-656697744301 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:30.239386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830da4d-8bff-46db-b627-656697744301 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:30.239524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830da4d-8bff-46db-b627-656697744301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:30.287745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:30.306807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3830da4d-8bff-46db-b627-656697744301 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:30.308064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3830da4d-8bff-46db-b627-656697744301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:30.405198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:12:30.690519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711e8d4-015f-4e62-b439-bfa740d2254d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:30.692094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0711e8d4-015f-4e62-b439-bfa740d2254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:30.796065 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711e8d4-015f-4e62-b439-bfa740d2254d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:30.836669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:30.870780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ff4ef-20b9-4c2e-874f-d0b5d5f079dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:30.871414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ff4ef-20b9-4c2e-874f-d0b5d5f079dc service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:30.871692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ff4ef-20b9-4c2e-874f-d0b5d5f079dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:30.871963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ff4ef-20b9-4c2e-874f-d0b5d5f079dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:30.873554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-575ff4ef-20b9-4c2e-874f-d0b5d5f079dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:30.983931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ff4ef-20b9-4c2e-874f-d0b5d5f079dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:30.985358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ff4ef-20b9-4c2e-874f-d0b5d5f079dc service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:31.003681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 715/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:33.280750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8587-5552-4c96-aa53-49c4dfb2c9bf None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:33.281250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8587-5552-4c96-aa53-49c4dfb2c9bf None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:33.281250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db8587-5552-4c96-aa53-49c4dfb2c9bf None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:33.282588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:33.288339 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff77d6-ca06-488b-9c54-81cf455f3890 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:33.288812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff77d6-ca06-488b-9c54-81cf455f3890 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:33.288912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff77d6-ca06-488b-9c54-81cf455f3890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:33.354870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-03ff77d6-ca06-488b-9c54-81cf455f3890 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:33.356111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-03ff77d6-ca06-488b-9c54-81cf455f3890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:33.376201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:33.458975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:33.744525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db8587-5552-4c96-aa53-49c4dfb2c9bf None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:33.746064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-35db8587-5552-4c96-aa53-49c4dfb2c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:33.849893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db8587-5552-4c96-aa53-49c4dfb2c9bf None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:33.871206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:33.925187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e5844-aa7e-4f75-9ea1-8f2b366a76de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:33.925807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e5844-aa7e-4f75-9ea1-8f2b366a76de service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:33.926069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e5844-aa7e-4f75-9ea1-8f2b366a76de service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:33.926346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e5844-aa7e-4f75-9ea1-8f2b366a76de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:33.928301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c21e5844-aa7e-4f75-9ea1-8f2b366a76de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:34.036923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e5844-aa7e-4f75-9ea1-8f2b366a76de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:34.038276 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e5844-aa7e-4f75-9ea1-8f2b366a76de service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:34.056614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 736/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:36.357318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a04aa3-22a9-43b8-b473-0d058e45509e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:36.357886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a04aa3-22a9-43b8-b473-0d058e45509e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:36.357886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a04aa3-22a9-43b8-b473-0d058e45509e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:36.359266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:36.365652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6da53-fd30-4711-994e-c9123873fada None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:36.366063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6da53-fd30-4711-994e-c9123873fada None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:36.366203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6da53-fd30-4711-994e-c9123873fada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:36.430845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:36.433917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-04a6da53-fd30-4711-994e-c9123873fada None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:36.435718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-04a6da53-fd30-4711-994e-c9123873fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:36.532059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:36.817408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a04aa3-22a9-43b8-b473-0d058e45509e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:36.818963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a3a04aa3-22a9-43b8-b473-0d058e45509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:36.922664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a04aa3-22a9-43b8-b473-0d058e45509e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:36.972954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:36.997744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a99e8-88e2-49b8-aaf5-d9058e110735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:36.998456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a99e8-88e2-49b8-aaf5-d9058e110735 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:36.998772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a99e8-88e2-49b8-aaf5-d9058e110735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:36.999087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a99e8-88e2-49b8-aaf5-d9058e110735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:37.000688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d36a99e8-88e2-49b8-aaf5-d9058e110735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:37.108612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a99e8-88e2-49b8-aaf5-d9058e110735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:37.109956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a99e8-88e2-49b8-aaf5-d9058e110735 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:37.128262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 718/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:39.554759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0da45-3eb6-4d06-8940-1b6791c08a98 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.555319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0da45-3eb6-4d06-8940-1b6791c08a98 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.555319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0da45-3eb6-4d06-8940-1b6791c08a98 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.556686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:39.562085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97163-28e6-44be-b61e-d612d2ce9cff None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:39.562511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97163-28e6-44be-b61e-d612d2ce9cff None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:39.562641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97163-28e6-44be-b61e-d612d2ce9cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:39.630600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d9b97163-28e6-44be-b61e-d612d2ce9cff None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:39.631838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d9b97163-28e6-44be-b61e-d612d2ce9cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:39.660595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:39.728112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:40.015481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0da45-3eb6-4d06-8940-1b6791c08a98 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:40.017083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d8e0da45-3eb6-4d06-8940-1b6791c08a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:40.122677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0da45-3eb6-4d06-8940-1b6791c08a98 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:40.151231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:40.197130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7c81f-ebfc-4c74-a8b1-02283c5d3d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:40.197731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c81f-ebfc-4c74-a8b1-02283c5d3d8b service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:40.198010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c81f-ebfc-4c74-a8b1-02283c5d3d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:40.198285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7c81f-ebfc-4c74-a8b1-02283c5d3d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:40.199906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-06c7c81f-ebfc-4c74-a8b1-02283c5d3d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:40.309904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7c81f-ebfc-4c74-a8b1-02283c5d3d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:40.311287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7c81f-ebfc-4c74-a8b1-02283c5d3d8b service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:40.329554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 739/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:42.544796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900712-0fe1-4160-ac23-ca2d22d4b90b None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:42.545370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900712-0fe1-4160-ac23-ca2d22d4b90b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:42.545370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59900712-0fe1-4160-ac23-ca2d22d4b90b None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:42.546717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:42.553183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f9529-029e-4c60-8b57-5a9de2ef1283 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:42.553606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f9529-029e-4c60-8b57-5a9de2ef1283 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:42.553736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f9529-029e-4c60-8b57-5a9de2ef1283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:42.620137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-127f9529-029e-4c60-8b57-5a9de2ef1283 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:42.621361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-127f9529-029e-4c60-8b57-5a9de2ef1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:42.630208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:42.718500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:43.008300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59900712-0fe1-4160-ac23-ca2d22d4b90b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:43.009851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-59900712-0fe1-4160-ac23-ca2d22d4b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:43.112787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59900712-0fe1-4160-ac23-ca2d22d4b90b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:43.168232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:43.186607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a01f36-e611-4bf5-adb0-45187ca12e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:43.187238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01f36-e611-4bf5-adb0-45187ca12e57 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:43.187521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01f36-e611-4bf5-adb0-45187ca12e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:43.187798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01f36-e611-4bf5-adb0-45187ca12e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:43.190191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-62a01f36-e611-4bf5-adb0-45187ca12e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:43.297293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a01f36-e611-4bf5-adb0-45187ca12e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:43.298634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a01f36-e611-4bf5-adb0-45187ca12e57 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:43.321722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 721/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:45.522916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c527c9-fd84-4a90-9979-a4727e76bb10 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.523447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c527c9-fd84-4a90-9979-a4727e76bb10 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.523447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c527c9-fd84-4a90-9979-a4727e76bb10 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.524788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:45.530082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40979c-8589-4a1a-bbe6-43b03d4ec911 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:45.530483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40979c-8589-4a1a-bbe6-43b03d4ec911 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:45.530638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40979c-8589-4a1a-bbe6-43b03d4ec911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:45.598920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9b40979c-8589-4a1a-bbe6-43b03d4ec911 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:45.600167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9b40979c-8589-4a1a-bbe6-43b03d4ec911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:45.637613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:45.695321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:45.990383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c527c9-fd84-4a90-9979-a4727e76bb10 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:45.992012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b3c527c9-fd84-4a90-9979-a4727e76bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:46.097367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c527c9-fd84-4a90-9979-a4727e76bb10 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:46.135777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:46.172984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9672c-672b-471a-9894-290aa6eecebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:46.173619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9672c-672b-471a-9894-290aa6eecebe service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:46.173951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9672c-672b-471a-9894-290aa6eecebe service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:46.174234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9672c-672b-471a-9894-290aa6eecebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:46.175945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0fc9672c-672b-471a-9894-290aa6eecebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:46.286035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9672c-672b-471a-9894-290aa6eecebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:46.287415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9672c-672b-471a-9894-290aa6eecebe service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:46.306594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 742/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:48.550578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19355ef6-f7b3-4cb3-830f-5519689cad84 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:48.551208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19355ef6-f7b3-4cb3-830f-5519689cad84 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:48.551208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19355ef6-f7b3-4cb3-830f-5519689cad84 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:48.552546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:48.558043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443334c-1546-4deb-9765-5b069d7b2782 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:48.558453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443334c-1546-4deb-9765-5b069d7b2782 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:48.558589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443334c-1546-4deb-9765-5b069d7b2782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:48.624159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4443334c-1546-4deb-9765-5b069d7b2782 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:48.625371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4443334c-1546-4deb-9765-5b069d7b2782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:48.643959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:48.721518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:49.010248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19355ef6-f7b3-4cb3-830f-5519689cad84 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:49.011832 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-19355ef6-f7b3-4cb3-830f-5519689cad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:49.115977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19355ef6-f7b3-4cb3-830f-5519689cad84 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:49.182808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:49.189928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e311a3-f2fa-4f39-932a-7ae193789bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:49.190558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e311a3-f2fa-4f39-932a-7ae193789bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:49.190839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e311a3-f2fa-4f39-932a-7ae193789bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:49.191144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e311a3-f2fa-4f39-932a-7ae193789bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:49.192757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-89e311a3-f2fa-4f39-932a-7ae193789bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:49.302363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e311a3-f2fa-4f39-932a-7ae193789bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:49.303741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e311a3-f2fa-4f39-932a-7ae193789bc9 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:49.321964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 724/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:12:51.482044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674608d-4848-4403-8feb-c6aaf92243a6 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.482549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674608d-4848-4403-8feb-c6aaf92243a6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.482549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674608d-4848-4403-8feb-c6aaf92243a6 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.483947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:12:51.489927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c813d-9260-47f5-a012-539aab82c807 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:51.490358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c813d-9260-47f5-a012-539aab82c807 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:51.490486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c813d-9260-47f5-a012-539aab82c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:51.561465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-811c813d-9260-47f5-a012-539aab82c807 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:12:51.563318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-811c813d-9260-47f5-a012-539aab82c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:51.613930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:51.663883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:12:51.952829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674608d-4848-4403-8feb-c6aaf92243a6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:12:51.954388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5674608d-4848-4403-8feb-c6aaf92243a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:52.057498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674608d-4848-4403-8feb-c6aaf92243a6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:12:52.106562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:12:52.133099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db157fe-97c4-45ad-972a-f5afab063ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:12:52.133705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db157fe-97c4-45ad-972a-f5afab063ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:12:52.133988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db157fe-97c4-45ad-972a-f5afab063ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:12:52.134266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db157fe-97c4-45ad-972a-f5afab063ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:12:52.135880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2db157fe-97c4-45ad-972a-f5afab063ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:12:52.244889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db157fe-97c4-45ad-972a-f5afab063ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:12:52.246232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db157fe-97c4-45ad-972a-f5afab063ad7 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:12:52.264705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 745/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:13:01.662354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=22 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:02.262470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=66 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:12.264170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167cb57-ba8a-4939-88de-ea14dec31a74 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.264766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167cb57-ba8a-4939-88de-ea14dec31a74 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.264766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167cb57-ba8a-4939-88de-ea14dec31a74 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.266123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 726/1471] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:12.271573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451169-6b64-4bfe-8f12-9b27ca5e301d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.272001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451169-6b64-4bfe-8f12-9b27ca5e301d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.272106 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1451169-6b64-4bfe-8f12-9b27ca5e301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.338098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d1451169-6b64-4bfe-8f12-9b27ca5e301d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:12.339356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d1451169-6b64-4bfe-8f12-9b27ca5e301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:12.436417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 746/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:13:12.737796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c12850-7314-4510-85a7-e46ca4c75a3d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.738079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c12850-7314-4510-85a7-e46ca4c75a3d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.738361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c12850-7314-4510-85a7-e46ca4c75a3d None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.739742 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 727/1473] 10.222.0.20 () {54 vars in 962 bytes} [Fri Sep 16 19:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:12.744672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeff64-0c39-4635-aa6a-9e0c603d02d2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:12.744958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeff64-0c39-4635-aa6a-9e0c603d02d2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:12.745262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeff64-0c39-4635-aa6a-9e0c603d02d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:12.821768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5afeff64-0c39-4635-aa6a-9e0c603d02d2 None None] MFA Rules not processed for user `a909fc6177e94d2fa6d38dad285e616a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:12.822966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5afeff64-0c39-4635-aa6a-9e0c603d02d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:12.843710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:12.899678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 747/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Fri Sep 16 19:13:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:13:12.907377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c12850-7314-4510-85a7-e46ca4c75a3d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:12.908945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-58c12850-7314-4510-85a7-e46ca4c75a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:13.015160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c12850-7314-4510-85a7-e46ca4c75a3d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:13.090066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938683a-c6ba-4f6b-9ac7-71260d569dff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a909fc6177e94d2fa6d38dad285e616a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:13.090688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938683a-c6ba-4f6b-9ac7-71260d569dff service glance] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:13.090950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938683a-c6ba-4f6b-9ac7-71260d569dff service glance] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:13.091261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938683a-c6ba-4f6b-9ac7-71260d569dff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:13.092864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e938683a-c6ba-4f6b-9ac7-71260d569dff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:13.147075 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:13.201445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938683a-c6ba-4f6b-9ac7-71260d569dff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:13.202862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938683a-c6ba-4f6b-9ac7-71260d569dff service glance] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:13.221196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 728/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:13:15.459793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eb4c2-ef7c-4b3a-b3cc-d43120b1baeb None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:15.460233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eb4c2-ef7c-4b3a-b3cc-d43120b1baeb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:15.460338 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eb4c2-ef7c-4b3a-b3cc-d43120b1baeb None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:15.461767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 748/1476] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:15.467395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046b2a-42d5-4a2c-a4dc-d6dca0c493ac None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:15.467846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046b2a-42d5-4a2c-a4dc-d6dca0c493ac None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:15.467950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046b2a-42d5-4a2c-a4dc-d6dca0c493ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:15.533766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c0046b2a-42d5-4a2c-a4dc-d6dca0c493ac None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:15.534964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c0046b2a-42d5-4a2c-a4dc-d6dca0c493ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:15.632632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 729/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:13:15.904036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82eb4c2-ef7c-4b3a-b3cc-d43120b1baeb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:15.905497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d82eb4c2-ef7c-4b3a-b3cc-d43120b1baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:16.038421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82eb4c2-ef7c-4b3a-b3cc-d43120b1baeb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:16.209319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:16.254946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f664b-acfa-4b9a-8d87-d9bd40518398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:16.255572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f664b-acfa-4b9a-8d87-d9bd40518398 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:16.255847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f664b-acfa-4b9a-8d87-d9bd40518398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:16.256115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f664b-acfa-4b9a-8d87-d9bd40518398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:16.256745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f664b-acfa-4b9a-8d87-d9bd40518398 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:16.258460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-077f664b-acfa-4b9a-8d87-d9bd40518398 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:13:16.258460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: warnings.warn(msg) Sep 16 19:13:16.258460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: Sep 16 19:13:16.259610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f664b-acfa-4b9a-8d87-d9bd40518398 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:16.278393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 749/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Fri Sep 16 19:13:15 2022] GET /identity/v3/projects => generated 2553 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:13:18.457181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d126-3eb4-465f-bf2a-b97ad1ae1930 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:18.457613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d126-3eb4-465f-bf2a-b97ad1ae1930 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:18.457730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d126-3eb4-465f-bf2a-b97ad1ae1930 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:18.459234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 730/1479] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:18.464248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a1a1-5931-4b6e-a62e-6cf7d03d2a40 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:18.464664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a1a1-5931-4b6e-a62e-6cf7d03d2a40 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:18.464799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17a1a1-5931-4b6e-a62e-6cf7d03d2a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:18.531497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8b17a1a1-5931-4b6e-a62e-6cf7d03d2a40 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:18.532701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8b17a1a1-5931-4b6e-a62e-6cf7d03d2a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:18.627770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 750/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:13:18.928448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51d126-3eb4-465f-bf2a-b97ad1ae1930 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:18.930058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0e51d126-3eb4-465f-bf2a-b97ad1ae1930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:18.940252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:19.075293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51d126-3eb4-465f-bf2a-b97ad1ae1930 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:19.157460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:19.190132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85103-d687-4a67-95b5-3c4578d6a8f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:19.190674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85103-d687-4a67-95b5-3c4578d6a8f4 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:19.190953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85103-d687-4a67-95b5-3c4578d6a8f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:19.191259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85103-d687-4a67-95b5-3c4578d6a8f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:19.192866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-11d85103-d687-4a67-95b5-3c4578d6a8f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:19.282779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d85103-d687-4a67-95b5-3c4578d6a8f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:19.284427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d85103-d687-4a67-95b5-3c4578d6a8f4 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:19.302601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 731/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:13:21.640862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645733dd-030a-4b33-b8c6-5ba1a88a2805 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.641403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645733dd-030a-4b33-b8c6-5ba1a88a2805 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.641403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645733dd-030a-4b33-b8c6-5ba1a88a2805 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.643435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 751/1482] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:21.649363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7584a6-5f87-4242-b4ce-6615a1f2b394 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:21.649867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7584a6-5f87-4242-b4ce-6615a1f2b394 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:21.650264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7584a6-5f87-4242-b4ce-6615a1f2b394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:21.716734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5a7584a6-5f87-4242-b4ce-6615a1f2b394 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:21.717964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5a7584a6-5f87-4242-b4ce-6615a1f2b394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:21.766353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:21.816918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 732/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:13:22.119342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645733dd-030a-4b33-b8c6-5ba1a88a2805 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:22.120857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-645733dd-030a-4b33-b8c6-5ba1a88a2805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:22.145604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:22.226054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645733dd-030a-4b33-b8c6-5ba1a88a2805 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:22.300424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239dfd8-f6c9-48ec-a0bf-8e0dd6356672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:22.301024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239dfd8-f6c9-48ec-a0bf-8e0dd6356672 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:22.301303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239dfd8-f6c9-48ec-a0bf-8e0dd6356672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:22.301575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239dfd8-f6c9-48ec-a0bf-8e0dd6356672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:22.303184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5239dfd8-f6c9-48ec-a0bf-8e0dd6356672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:22.377653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:22.411585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239dfd8-f6c9-48ec-a0bf-8e0dd6356672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:22.413025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239dfd8-f6c9-48ec-a0bf-8e0dd6356672 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:22.431658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 752/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:13:24.632695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce09fa-913c-405c-b236-808ea3632d53 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.633271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce09fa-913c-405c-b236-808ea3632d53 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.633271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce09fa-913c-405c-b236-808ea3632d53 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.634579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 733/1485] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:24.639916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663a93-bcb8-40c1-b3dd-dd2489739eea None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:24.640313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663a93-bcb8-40c1-b3dd-dd2489739eea None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:24.640460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8663a93-bcb8-40c1-b3dd-dd2489739eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:24.710095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c8663a93-bcb8-40c1-b3dd-dd2489739eea None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:24.711348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c8663a93-bcb8-40c1-b3dd-dd2489739eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:24.806507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 753/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:13:25.098658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce09fa-913c-405c-b236-808ea3632d53 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:25.100485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-27ce09fa-913c-405c-b236-808ea3632d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:25.202951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce09fa-913c-405c-b236-808ea3632d53 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:25.276738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:25.278250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787fcf9-f711-4067-92d0-e411fef502ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:25.278963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fcf9-f711-4067-92d0-e411fef502ec service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:25.279306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fcf9-f711-4067-92d0-e411fef502ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:25.279617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787fcf9-f711-4067-92d0-e411fef502ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:25.281760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8787fcf9-f711-4067-92d0-e411fef502ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:25.389370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787fcf9-f711-4067-92d0-e411fef502ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:25.390714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787fcf9-f711-4067-92d0-e411fef502ec service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:25.409578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 734/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:13:27.658572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6c0f2-dd75-4b16-8ad2-5bf68b9e7625 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.659148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6c0f2-dd75-4b16-8ad2-5bf68b9e7625 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.659148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6c0f2-dd75-4b16-8ad2-5bf68b9e7625 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.660487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 754/1488] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:27.665822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991e870-1c77-4c80-b60e-5e156c9a4378 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:27.666276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991e870-1c77-4c80-b60e-5e156c9a4378 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:27.666421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991e870-1c77-4c80-b60e-5e156c9a4378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:27.732161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3991e870-1c77-4c80-b60e-5e156c9a4378 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:27.733373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3991e870-1c77-4c80-b60e-5e156c9a4378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:27.786427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:27.832523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 735/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:13:28.129045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6c0f2-dd75-4b16-8ad2-5bf68b9e7625 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:28.130563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-59b6c0f2-dd75-4b16-8ad2-5bf68b9e7625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:28.166156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:28.237866 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6c0f2-dd75-4b16-8ad2-5bf68b9e7625 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:28.311042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ca13a-e99c-4caa-bcea-189aacf1f999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:28.311641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca13a-e99c-4caa-bcea-189aacf1f999 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:28.311917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca13a-e99c-4caa-bcea-189aacf1f999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:28.312186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ca13a-e99c-4caa-bcea-189aacf1f999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:28.313789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ef8ca13a-e99c-4caa-bcea-189aacf1f999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:28.393360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:28.422887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ca13a-e99c-4caa-bcea-189aacf1f999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:28.424533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ca13a-e99c-4caa-bcea-189aacf1f999 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:28.443083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 755/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:13:30.773475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97080b0-6cae-4c39-ac42-e4dc4194b2b2 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.774043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97080b0-6cae-4c39-ac42-e4dc4194b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.774043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97080b0-6cae-4c39-ac42-e4dc4194b2b2 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.775433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 736/1491] 10.222.0.20 () {54 vars in 927 bytes} [Fri Sep 16 19:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:13:30.780603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f59f96-4199-43fa-9a08-9a3bd05320ed None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:30.781025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f59f96-4199-43fa-9a08-9a3bd05320ed None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:30.781139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f59f96-4199-43fa-9a08-9a3bd05320ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:30.847393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-01f59f96-4199-43fa-9a08-9a3bd05320ed None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:13:30.848601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-01f59f96-4199-43fa-9a08-9a3bd05320ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:30.945674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 756/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Fri Sep 16 19:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:13:31.235453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97080b0-6cae-4c39-ac42-e4dc4194b2b2 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:13:31.237546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b97080b0-6cae-4c39-ac42-e4dc4194b2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:31.340203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97080b0-6cae-4c39-ac42-e4dc4194b2b2 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:13:31.413132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ba282-35bd-4fbe-8ffe-12be14ddd268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:13:31.413835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ba282-35bd-4fbe-8ffe-12be14ddd268 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:13:31.414203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ba282-35bd-4fbe-8ffe-12be14ddd268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:13:31.414589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ba282-35bd-4fbe-8ffe-12be14ddd268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:13:31.416309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7e9ba282-35bd-4fbe-8ffe-12be14ddd268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:13:31.426008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:31.528555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ba282-35bd-4fbe-8ffe-12be14ddd268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:13:31.529912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ba282-35bd-4fbe-8ffe-12be14ddd268 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:13:31.549284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 737/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:13:40.944232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=82 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:13:41.546416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=50 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:46.855373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ce83-2406-4165-b8cd-87e6586f29af None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:46.855869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ce83-2406-4165-b8cd-87e6586f29af None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:46.855991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922ce83-2406-4165-b8cd-87e6586f29af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:46.930896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a922ce83-2406-4165-b8cd-87e6586f29af None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:46.932125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a922ce83-2406-4165-b8cd-87e6586f29af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:47.028103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 757/1494] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:14:47.036835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2341ba-474a-4038-ad94-52d99d499d7d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.037338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2341ba-474a-4038-ad94-52d99d499d7d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.037447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2341ba-474a-4038-ad94-52d99d499d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.113093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9b2341ba-474a-4038-ad94-52d99d499d7d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:47.114231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9b2341ba-474a-4038-ad94-52d99d499d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:47.215983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 738/1495] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:14:47.220810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ce83-2406-4165-b8cd-87e6586f29af None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.223236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a922ce83-2406-4165-b8cd-87e6586f29af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:47.234507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922ce83-2406-4165-b8cd-87e6586f29af None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.298724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.332341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.332965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.333243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.333516 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.334154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:14:47.334474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.335545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:14:47.335545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: warnings.warn(msg) Sep 16 19:14:47.335545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: Sep 16 19:14:47.336424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.348404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 758/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:14:47.356923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2341ba-474a-4038-ad94-52d99d499d7d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.366091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2341ba-474a-4038-ad94-52d99d499d7d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.428726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.463015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.463628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.463906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.464178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.464793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.466506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:14:47.466506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: warnings.warn(msg) Sep 16 19:14:47.466506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: Sep 16 19:14:47.467727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.523668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 739/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:14:47 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:47.527828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.529322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:47.563653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20eb96-0567-4afc-b91a-cb3bad690a15 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.658339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.659179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.659458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.659731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.660378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.661377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:14:47.661377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: warnings.warn(msg) Sep 16 19:14:47.661377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: Sep 16 19:14:47.662568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.704520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 759/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:14:47 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:14:47.709453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.710950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:47.772297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d6224-e59f-4e73-8690-0c1b1d671c99 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.854365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.866091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.866703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.866985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.867311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.867933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.868944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:14:47.868944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: warnings.warn(msg) Sep 16 19:14:47.868944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: Sep 16 19:14:47.869867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:47.883157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 740/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:14:47.887169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:47.888682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:47.900663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03971b7-2f4e-417a-b9f4-bce80baab998 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:47.925318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:47.995799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db248be2-1791-4072-a2e9-885c8f0ea918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:47.996396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db248be2-1791-4072-a2e9-885c8f0ea918 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:47.996671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db248be2-1791-4072-a2e9-885c8f0ea918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:47.996938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db248be2-1791-4072-a2e9-885c8f0ea918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:47.997568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db248be2-1791-4072-a2e9-885c8f0ea918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:47.998569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-db248be2-1791-4072-a2e9-885c8f0ea918 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:14:47.998569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: warnings.warn(msg) Sep 16 19:14:47.998569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: Sep 16 19:14:47.999465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db248be2-1791-4072-a2e9-885c8f0ea918 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:48.012441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 760/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:14:48.016800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:48.018351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:48.052261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7492d-7f7b-42a4-bc8c-65e17a9a8b8b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:48.146565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c40f45-d30c-431b-b200-a7534424993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:48.147237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40f45-d30c-431b-b200-a7534424993a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.147514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40f45-d30c-431b-b200-a7534424993a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.147785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c40f45-d30c-431b-b200-a7534424993a admin admin] PATH_INFO: `/v3/projects/7922d4d6c07e4cefaf6039227972b5c9/users/b769a238389f405ca80273ad14018c77/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.169765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c40f45-d30c-431b-b200-a7534424993a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7922d4d6c07e4cefaf6039227972b5c9, user_id=b769a238389f405ca80273ad14018c77, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:48.170784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-d2c40f45-d30c-431b-b200-a7534424993a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:14:48.170784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: warnings.warn(msg) Sep 16 19:14:48.170784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: Sep 16 19:14:48.172753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c40f45-d30c-431b-b200-a7534424993a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:48.198410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 741/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:14:48 2022] PUT /identity/v3/projects/7922d4d6c07e4cefaf6039227972b5c9/users/b769a238389f405ca80273ad14018c77/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:14:48.210677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b85c-1573-432a-b58f-4aa0458a9a63 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.210960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b85c-1573-432a-b58f-4aa0458a9a63 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.211272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061b85c-1573-432a-b58f-4aa0458a9a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.269774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a061b85c-1573-432a-b58f-4aa0458a9a63 None None] MFA Rules not processed for user `b769a238389f405ca80273ad14018c77`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:48.271029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a061b85c-1573-432a-b58f-4aa0458a9a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:48.349279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 761/1502] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:14:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:14:48.363430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff92d-30e0-48af-8ace-bc20f406d194 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.363716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff92d-30e0-48af-8ace-bc20f406d194 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.363993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaff92d-30e0-48af-8ace-bc20f406d194 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.365335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 742/1503] 10.222.0.20 () {54 vars in 964 bytes} [Fri Sep 16 19:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:48.371354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af52def-b81d-4631-95bf-546a6b2e95a9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.371859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af52def-b81d-4631-95bf-546a6b2e95a9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.372403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af52def-b81d-4631-95bf-546a6b2e95a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.406678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:48.453070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7af52def-b81d-4631-95bf-546a6b2e95a9 None None] MFA Rules not processed for user `1ef7ff56b97e4ca3af05cc407419d906`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:48.454210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7af52def-b81d-4631-95bf-546a6b2e95a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:48.528522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 762/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Fri Sep 16 19:14:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:14:48.536758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff92d-30e0-48af-8ace-bc20f406d194 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:48.538267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cbaff92d-30e0-48af-8ace-bc20f406d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:48.589168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:48.644795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaff92d-30e0-48af-8ace-bc20f406d194 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:48.717788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:48.718352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.718631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.718901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.720518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:48.817685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:48.819145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:48.822560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:48.838020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 743/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:14:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:14:48.883054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842a34-1309-4941-ba3c-1df3e50e292f None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:48.883349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842a34-1309-4941-ba3c-1df3e50e292f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:48.883629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842a34-1309-4941-ba3c-1df3e50e292f None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:48.884924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 763/1506] 10.222.0.20 () {52 vars in 830 bytes} [Fri Sep 16 19:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:14:48.888438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:48.889658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:48.989838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c2363-7917-4c06-b4d2-033a82aa67d5 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:49.082880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:49.083557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.083798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.084069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] PATH_INFO: `/v3/users/b769a238389f405ca80273ad14018c77` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.097476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b769a238389f405ca80273ad14018c77)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:49.098737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:14:49.098737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: warnings.warn(msg) Sep 16 19:14:49.098737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: Sep 16 19:14:49.099970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:49.109937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:49.168109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b769a238389f405ca80273ad14018c77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:49.177058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b769a238389f405ca80273ad14018c77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:49.177732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b769a238389f405ca80273ad14018c77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:49.178215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b769a238389f405ca80273ad14018c77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:49.192362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b769a238389f405ca80273ad14018c77'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:49.220594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 744/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:14:48 2022] DELETE /identity/v3/users/b769a238389f405ca80273ad14018c77 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:14:49.225500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87d14a-fa88-432b-9cbf-47fae5fb0f59 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.225979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87d14a-fa88-432b-9cbf-47fae5fb0f59 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.226104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87d14a-fa88-432b-9cbf-47fae5fb0f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.282890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2c87d14a-fa88-432b-9cbf-47fae5fb0f59 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:14:49.284284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2c87d14a-fa88-432b-9cbf-47fae5fb0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:49.362525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:49.375387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 764/1508] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:14:49.386025 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:49.387266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:49.488421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0b875-d4b5-4e65-b0df-50f3af6691e8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:49.542275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:14:49.563590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1dec83-e751-4b70-ab91-29f317807066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:49.564205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dec83-e751-4b70-ab91-29f317807066 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:49.564486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dec83-e751-4b70-ab91-29f317807066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:49.565331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1dec83-e751-4b70-ab91-29f317807066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:49.567050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7f1dec83-e751-4b70-ab91-29f317807066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:49.674828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dec83-e751-4b70-ab91-29f317807066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:49.676359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1dec83-e751-4b70-ab91-29f317807066 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:49.694563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 745/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:14:50.016326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87d14a-fa88-432b-9cbf-47fae5fb0f59 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:14:50.017563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2c87d14a-fa88-432b-9cbf-47fae5fb0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:14:50.031420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87d14a-fa88-432b-9cbf-47fae5fb0f59 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:14:50.132970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:14:50.133527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:14:50.133803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:14:50.134080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] PATH_INFO: `/v3/projects/7922d4d6c07e4cefaf6039227972b5c9` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:14:50.143913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7922d4d6c07e4cefaf6039227972b5c9)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:14:50.144940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:14:50.144940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: warnings.warn(msg) Sep 16 19:14:50.144940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: Sep 16 19:14:50.146127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:14:50.204693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7922d4d6c07e4cefaf6039227972b5c9', 'request_id': 'req-c09fef3d-f973-44e3-9eef-d7ee04a75a90'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:50.218514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7922d4d6c07e4cefaf6039227972b5c9', 'request_id': 'req-c09fef3d-f973-44e3-9eef-d7ee04a75a90'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:50.229222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7922d4d6c07e4cefaf6039227972b5c9', 'request_id': 'req-c09fef3d-f973-44e3-9eef-d7ee04a75a90'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:50.251390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] The token cache is being invalidate because project 7922d4d6c07e4cefaf6039227972b5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:14:50.251688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:50.252349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c09fef3d-f973-44e3-9eef-d7ee04a75a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:14:50.253966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 765/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:14:50 2022] DELETE /identity/v3/projects/7922d4d6c07e4cefaf6039227972b5c9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:14:59.692439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=62 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:15:00.249253 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:21.701878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25449-355b-4292-aef1-68e958c3dd21 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:21.702467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25449-355b-4292-aef1-68e958c3dd21 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:21.702467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25449-355b-4292-aef1-68e958c3dd21 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:21.703814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:21.709130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d7a2-193c-4b2e-bca4-f76dc1d592c5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:21.709642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d7a2-193c-4b2e-bca4-f76dc1d592c5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:21.709747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d7a2-193c-4b2e-bca4-f76dc1d592c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:21.790896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0f33d7a2-193c-4b2e-bca4-f76dc1d592c5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:21.792130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0f33d7a2-193c-4b2e-bca4-f76dc1d592c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:21.896063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:22.049731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25449-355b-4292-aef1-68e958c3dd21 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:22.051876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-35b25449-355b-4292-aef1-68e958c3dd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:22.171687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25449-355b-4292-aef1-68e958c3dd21 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:22.178380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce016bf-7a04-4ab8-9db7-e98554478bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:22.178987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce016bf-7a04-4ab8-9db7-e98554478bf7 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:22.179289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce016bf-7a04-4ab8-9db7-e98554478bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:22.179561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce016bf-7a04-4ab8-9db7-e98554478bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:22.187456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce016bf-7a04-4ab8-9db7-e98554478bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:22.189330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce016bf-7a04-4ab8-9db7-e98554478bf7 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:22.198596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 747/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:16:23.294124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f597-610f-4abb-a2bf-512dc9a292ed None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:23.294650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f597-610f-4abb-a2bf-512dc9a292ed None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:23.294650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828f597-610f-4abb-a2bf-512dc9a292ed None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:23.295961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:23.303306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7adf-0e3c-47b8-8a99-6d0064dec393 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:23.303761 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7adf-0e3c-47b8-8a99-6d0064dec393 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:23.303945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7adf-0e3c-47b8-8a99-6d0064dec393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:23.324643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2cfe7adf-0e3c-47b8-8a99-6d0064dec393 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:23.325838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2cfe7adf-0e3c-47b8-8a99-6d0064dec393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:23.334535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:23.487337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828f597-610f-4abb-a2bf-512dc9a292ed None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:23.502162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828f597-610f-4abb-a2bf-512dc9a292ed None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:23.507538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fece4f-33ab-4b6b-8e62-7ba51179bd36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:23.508124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fece4f-33ab-4b6b-8e62-7ba51179bd36 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:23.508400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fece4f-33ab-4b6b-8e62-7ba51179bd36 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:23.508671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fece4f-33ab-4b6b-8e62-7ba51179bd36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:23.516730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fece4f-33ab-4b6b-8e62-7ba51179bd36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:23.518387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fece4f-33ab-4b6b-8e62-7ba51179bd36 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:23.527655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 768/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:16:23.761289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1022-bbbd-4d5c-b431-601dc732463d None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:23.761573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1022-bbbd-4d5c-b431-601dc732463d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:23.761855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb1022-bbbd-4d5c-b431-601dc732463d None None] PATH_INFO: `/v3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:23.763204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 749/1517] 10.222.0.25 () {54 vars in 925 bytes} [Fri Sep 16 19:16:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:16:23.769635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830678-a8a1-4413-ab5f-2d05fe3fe59f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:23.769925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830678-a8a1-4413-ab5f-2d05fe3fe59f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:23.770206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb830678-a8a1-4413-ab5f-2d05fe3fe59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:23.829902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-eb830678-a8a1-4413-ab5f-2d05fe3fe59f None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:23.831073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-eb830678-a8a1-4413-ab5f-2d05fe3fe59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:23.847744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:23.902251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 769/1518] 10.222.0.25 () {58 vars in 1015 bytes} [Fri Sep 16 19:16:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:32.812462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2fea4-d3cc-41b2-aeca-6dc321ebdc36 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:32.813576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2fea4-d3cc-41b2-aeca-6dc321ebdc36 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:32.813576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2fea4-d3cc-41b2-aeca-6dc321ebdc36 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:32.815356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 750/1519] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 16 19:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:32.820429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dd57-c58f-4ea8-93fb-9ff2bea6f2c4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:32.820859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dd57-c58f-4ea8-93fb-9ff2bea6f2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:32.820974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7dd57-c58f-4ea8-93fb-9ff2bea6f2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:32.843611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bee7dd57-c58f-4ea8-93fb-9ff2bea6f2c4 None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:32.845200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bee7dd57-c58f-4ea8-93fb-9ff2bea6f2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:32.854115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 770/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 16 19:16:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:32.862049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2fea4-d3cc-41b2-aeca-6dc321ebdc36 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:32.875918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2fea4-d3cc-41b2-aeca-6dc321ebdc36 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:32.880889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c5885-6788-4244-bf8d-67f636e2a7e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:32.881484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c5885-6788-4244-bf8d-67f636e2a7e1 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:32.881764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c5885-6788-4244-bf8d-67f636e2a7e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:32.882042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c5885-6788-4244-bf8d-67f636e2a7e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:32.893245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c5885-6788-4244-bf8d-67f636e2a7e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:32.894822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c5885-6788-4244-bf8d-67f636e2a7e1 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:32.904679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 751/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:16:34.997610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d1e3-8472-473f-82c2-6c4e6ee00883 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:34.998190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d1e3-8472-473f-82c2-6c4e6ee00883 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:34.998190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d1e3-8472-473f-82c2-6c4e6ee00883 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:34.999543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:35.006337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fabe34-3061-486d-b28d-87f485636353 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:35.006763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fabe34-3061-486d-b28d-87f485636353 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:35.006891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fabe34-3061-486d-b28d-87f485636353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:35.027448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-11fabe34-3061-486d-b28d-87f485636353 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:35.028642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-11fabe34-3061-486d-b28d-87f485636353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:35.036797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:35.194799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d1e3-8472-473f-82c2-6c4e6ee00883 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:35.209559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d1e3-8472-473f-82c2-6c4e6ee00883 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:35.215147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9a601-6864-4cd9-8e44-f471fa43644d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:35.215747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a601-6864-4cd9-8e44-f471fa43644d service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:35.216023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a601-6864-4cd9-8e44-f471fa43644d service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:35.216291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a601-6864-4cd9-8e44-f471fa43644d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:35.225459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9a601-6864-4cd9-8e44-f471fa43644d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:35.227102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9a601-6864-4cd9-8e44-f471fa43644d service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:35.237674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 772/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:16:36.316231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093390d8-1823-4430-a711-4f1eb9b776dd None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:36.316800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093390d8-1823-4430-a711-4f1eb9b776dd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:36.316800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093390d8-1823-4430-a711-4f1eb9b776dd None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:36.318111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 19:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:36.324364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144276-5457-4ac9-87b3-7ae5f8479c10 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:36.324818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144276-5457-4ac9-87b3-7ae5f8479c10 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:36.324926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67144276-5457-4ac9-87b3-7ae5f8479c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:36.345462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-67144276-5457-4ac9-87b3-7ae5f8479c10 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:36.346678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-67144276-5457-4ac9-87b3-7ae5f8479c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:36.354785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 19:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:36.507070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093390d8-1823-4430-a711-4f1eb9b776dd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:36.522045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093390d8-1823-4430-a711-4f1eb9b776dd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:36.527386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf8d34-ee56-4424-a0c2-84547dc9cb8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:36.527975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf8d34-ee56-4424-a0c2-84547dc9cb8e service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:36.528250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf8d34-ee56-4424-a0c2-84547dc9cb8e service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:36.528522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf8d34-ee56-4424-a0c2-84547dc9cb8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:36.536453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf8d34-ee56-4424-a0c2-84547dc9cb8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:36.538001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf8d34-ee56-4424-a0c2-84547dc9cb8e service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:36.547115 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 754/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:16:40.518248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6bd5a-fecb-450a-be18-3eecbc0148d6 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:40.518931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6bd5a-fecb-450a-be18-3eecbc0148d6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:40.518931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6bd5a-fecb-450a-be18-3eecbc0148d6 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:40.520173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:40.525561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647e78-142e-488b-ba88-ba204dfa588d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:40.525995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647e78-142e-488b-ba88-ba204dfa588d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:40.526117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647e78-142e-488b-ba88-ba204dfa588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:40.546467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-11647e78-142e-488b-ba88-ba204dfa588d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:40.547717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-11647e78-142e-488b-ba88-ba204dfa588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:40.555635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:40.852895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6bd5a-fecb-450a-be18-3eecbc0148d6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:40.854604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b6c6bd5a-fecb-450a-be18-3eecbc0148d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:40.950933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6bd5a-fecb-450a-be18-3eecbc0148d6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:40.954739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca07d86-6a56-4ad2-bcd6-949744ee97a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:40.955385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07d86-6a56-4ad2-bcd6-949744ee97a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:40.955669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07d86-6a56-4ad2-bcd6-949744ee97a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:40.955949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca07d86-6a56-4ad2-bcd6-949744ee97a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:40.965539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca07d86-6a56-4ad2-bcd6-949744ee97a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:40.967015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca07d86-6a56-4ad2-bcd6-949744ee97a3 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:40.978124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 775/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:16:43.172950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646f34-ae79-4359-921c-8d430ea6850e None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:43.173665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646f34-ae79-4359-921c-8d430ea6850e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:43.173665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646f34-ae79-4359-921c-8d430ea6850e None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:43.174866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:43.180099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3481-3b4e-418a-b0b9-64c23261fe85 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:43.180544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3481-3b4e-418a-b0b9-64c23261fe85 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:43.180644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3481-3b4e-418a-b0b9-64c23261fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:43.200899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7a4d3481-3b4e-418a-b0b9-64c23261fe85 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:43.202102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7a4d3481-3b4e-418a-b0b9-64c23261fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:43.210570 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:43.507338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646f34-ae79-4359-921c-8d430ea6850e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:43.518531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646f34-ae79-4359-921c-8d430ea6850e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:43.522089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35edecc-abad-4ed1-ab78-5a2ec181ef5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:43.522696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35edecc-abad-4ed1-ab78-5a2ec181ef5a service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:43.523032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35edecc-abad-4ed1-ab78-5a2ec181ef5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:43.523320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35edecc-abad-4ed1-ab78-5a2ec181ef5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:43.533307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35edecc-abad-4ed1-ab78-5a2ec181ef5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:43.534755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35edecc-abad-4ed1-ab78-5a2ec181ef5a service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:43.544503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 757/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:16:47.101279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e142b-c39c-410a-9a54-7099c0abff8a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:47.101855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e142b-c39c-410a-9a54-7099c0abff8a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:47.101855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e142b-c39c-410a-9a54-7099c0abff8a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:47.103192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:47.108354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9330d1-da95-48a6-84ab-8f57cc0e31af None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:47.108796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9330d1-da95-48a6-84ab-8f57cc0e31af None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:47.108899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9330d1-da95-48a6-84ab-8f57cc0e31af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:47.128815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1b9330d1-da95-48a6-84ab-8f57cc0e31af None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:47.130028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1b9330d1-da95-48a6-84ab-8f57cc0e31af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:47.137775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:47.444408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e142b-c39c-410a-9a54-7099c0abff8a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:47.446084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4d4e142b-c39c-410a-9a54-7099c0abff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:47.510681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:47.524970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e142b-c39c-410a-9a54-7099c0abff8a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:47.528507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0021a9b-6c56-421a-8dea-79dc885212da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:47.529107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021a9b-6c56-421a-8dea-79dc885212da service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:47.529388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021a9b-6c56-421a-8dea-79dc885212da service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:47.529678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0021a9b-6c56-421a-8dea-79dc885212da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:47.539475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0021a9b-6c56-421a-8dea-79dc885212da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:47.540903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0021a9b-6c56-421a-8dea-79dc885212da service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:47.550502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 778/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:16:49.692801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6adf39-9cfe-43f3-af61-e683039faa50 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:49.693410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6adf39-9cfe-43f3-af61-e683039faa50 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:49.693410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6adf39-9cfe-43f3-af61-e683039faa50 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:49.694642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 19:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:16:49.699978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fab5bf-f450-49fd-939c-015c10301526 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:49.700434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fab5bf-f450-49fd-939c-015c10301526 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:49.700537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fab5bf-f450-49fd-939c-015c10301526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:49.720159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c8fab5bf-f450-49fd-939c-015c10301526 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:16:49.721356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c8fab5bf-f450-49fd-939c-015c10301526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:49.729420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 19:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:16:50.033120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6adf39-9cfe-43f3-af61-e683039faa50 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:16:50.034785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ad6adf39-9cfe-43f3-af61-e683039faa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:16:50.042260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=84 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:16:50.049284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6adf39-9cfe-43f3-af61-e683039faa50 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:16:50.052837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7a5cd-e52a-41fe-bf5a-b19fbe61e5de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:16:50.053462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a5cd-e52a-41fe-bf5a-b19fbe61e5de service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:16:50.053730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a5cd-e52a-41fe-bf5a-b19fbe61e5de service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:16:50.054005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a5cd-e52a-41fe-bf5a-b19fbe61e5de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:16:50.063747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7a5cd-e52a-41fe-bf5a-b19fbe61e5de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:16:50.065216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7a5cd-e52a-41fe-bf5a-b19fbe61e5de service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:16:50.074412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 760/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:16:59.714975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=11 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:17:00.070380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:21.013527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b1af-4276-4de6-9ad6-2ac881f863b2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.014169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b1af-4276-4de6-9ad6-2ac881f863b2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.014169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b1af-4276-4de6-9ad6-2ac881f863b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.023242 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a04c-7d54-4459-a2e7-369a5ae002a2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.023867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a04c-7d54-4459-a2e7-369a5ae002a2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.023867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a04c-7d54-4459-a2e7-369a5ae002a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.055020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cb27b1af-4276-4de6-9ad6-2ac881f863b2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.055020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cb27b1af-4276-4de6-9ad6-2ac881f863b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.056967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5cc8a04c-7d54-4459-a2e7-369a5ae002a2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.058650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5cc8a04c-7d54-4459-a2e7-369a5ae002a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.068581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 780/1540] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.078060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 761/1541] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:21.082541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c174f7-db5e-4496-952c-d6be47c56a6e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.083283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c174f7-db5e-4496-952c-d6be47c56a6e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.083837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c174f7-db5e-4496-952c-d6be47c56a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.098964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382146-22f3-4625-9ebd-949c45224666 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.099368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382146-22f3-4625-9ebd-949c45224666 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.099546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382146-22f3-4625-9ebd-949c45224666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.116720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-68c174f7-db5e-4496-952c-d6be47c56a6e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.118042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-68c174f7-db5e-4496-952c-d6be47c56a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.137650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a3382146-22f3-4625-9ebd-949c45224666 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.138589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 781/1542] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.139260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a3382146-22f3-4625-9ebd-949c45224666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.140670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e9994-7152-4bac-9c10-fd693f1a405e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.140670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e9994-7152-4bac-9c10-fd693f1a405e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.140670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e9994-7152-4bac-9c10-fd693f1a405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.154918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 762/1543] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:21.157003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3382146-22f3-4625-9ebd-949c45224666 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.173425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3382146-22f3-4625-9ebd-949c45224666 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.173959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f48e9994-7152-4bac-9c10-fd693f1a405e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.176072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f48e9994-7152-4bac-9c10-fd693f1a405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.180725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.181338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.181625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.182120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.182773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:21.183104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.184112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:18:21.184112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: warnings.warn(msg) Sep 16 19:18:21.184112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: Sep 16 19:18:21.184994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.201059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 782/1544] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.202667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e9994-7152-4bac-9c10-fd693f1a405e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.215522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 763/1545] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:21.221085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e9994-7152-4bac-9c10-fd693f1a405e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.224983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.236460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412d4c8-7fb8-4d29-b186-e032d4d22de7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.243559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949267-52b2-487c-99a1-e2af3da97680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.244204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949267-52b2-487c-99a1-e2af3da97680 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.245864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949267-52b2-487c-99a1-e2af3da97680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.246154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949267-52b2-487c-99a1-e2af3da97680 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.246825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949267-52b2-487c-99a1-e2af3da97680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:21.247163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949267-52b2-487c-99a1-e2af3da97680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.250027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949267-52b2-487c-99a1-e2af3da97680 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.253806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87413c08-991d-4537-af6c-50ac35baff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.254440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c08-991d-4537-af6c-50ac35baff54 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.254721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c08-991d-4537-af6c-50ac35baff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.255018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c08-991d-4537-af6c-50ac35baff54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.255675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87413c08-991d-4537-af6c-50ac35baff54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.257570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87413c08-991d-4537-af6c-50ac35baff54 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.287291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 783/1546] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:21.288601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3093b-a48f-437d-8ebb-55425204561f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.288900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3093b-a48f-437d-8ebb-55425204561f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.289182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3093b-a48f-437d-8ebb-55425204561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.336513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bde3093b-a48f-437d-8ebb-55425204561f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.337915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bde3093b-a48f-437d-8ebb-55425204561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.349682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 764/1547] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:18:21.351153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f09f-6085-4bd4-935b-d37393979d35 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.351578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f09f-6085-4bd4-935b-d37393979d35 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.351862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f09f-6085-4bd4-935b-d37393979d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.359794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 784/1548] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.360744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3093b-a48f-437d-8ebb-55425204561f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.380444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3093b-a48f-437d-8ebb-55425204561f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.381569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-06f8f09f-6085-4bd4-935b-d37393979d35 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.382804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-06f8f09f-6085-4bd4-935b-d37393979d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.450418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.451093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.451379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.451721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.452369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.453395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:18:21.453395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: warnings.warn(msg) Sep 16 19:18:21.453395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: Sep 16 19:18:21.454586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.457951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 765/1549] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.458869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8f09f-6085-4bd4-935b-d37393979d35 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.468201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8f09f-6085-4bd4-935b-d37393979d35 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.474812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019e74-3502-40bb-94d6-0e57ce0b3b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.475519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019e74-3502-40bb-94d6-0e57ce0b3b73 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.475822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019e74-3502-40bb-94d6-0e57ce0b3b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.476157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019e74-3502-40bb-94d6-0e57ce0b3b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.476903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019e74-3502-40bb-94d6-0e57ce0b3b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:21.477222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019e74-3502-40bb-94d6-0e57ce0b3b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.478798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019e74-3502-40bb-94d6-0e57ce0b3b73 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.483819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 785/1550] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:21.484933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.491271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 766/1551] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:21.492478 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d2bf6-548c-45ca-90ec-65990178b118 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.492767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d2bf6-548c-45ca-90ec-65990178b118 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.493036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d2bf6-548c-45ca-90ec-65990178b118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.515528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-345d2bf6-548c-45ca-90ec-65990178b118 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.516849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-345d2bf6-548c-45ca-90ec-65990178b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.549695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2f80-5691-4e52-be81-cfbad82e58c1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.554644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c71af7-3e81-4b7d-9f4c-22f968771109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.555293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71af7-3e81-4b7d-9f4c-22f968771109 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.555590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71af7-3e81-4b7d-9f4c-22f968771109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.555844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71af7-3e81-4b7d-9f4c-22f968771109 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.556477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c71af7-3e81-4b7d-9f4c-22f968771109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.558446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c71af7-3e81-4b7d-9f4c-22f968771109 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.579362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 767/1552] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.580625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f169a5-f642-4607-9b6b-c7a2faee49e6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.581456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f169a5-f642-4607-9b6b-c7a2faee49e6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.581931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f169a5-f642-4607-9b6b-c7a2faee49e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.582054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 786/1553] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:21.583168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cda36-be86-4c52-aeb1-e51a32186fd3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.583452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cda36-be86-4c52-aeb1-e51a32186fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.583732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cda36-be86-4c52-aeb1-e51a32186fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.602794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b3f169a5-f642-4607-9b6b-c7a2faee49e6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.604055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b3f169a5-f642-4607-9b6b-c7a2faee49e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.608290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a33cda36-be86-4c52-aeb1-e51a32186fd3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.609459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a33cda36-be86-4c52-aeb1-e51a32186fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.619636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 768/1554] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.619636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068097f5-e53c-4473-b855-d61066fa0243 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.619636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068097f5-e53c-4473-b855-d61066fa0243 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.619636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068097f5-e53c-4473-b855-d61066fa0243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.625308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 787/1555] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.626528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51d18a-b9ad-44f2-a8a7-d7f76b624533 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.626817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51d18a-b9ad-44f2-a8a7-d7f76b624533 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.627124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51d18a-b9ad-44f2-a8a7-d7f76b624533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.634577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-068097f5-e53c-4473-b855-d61066fa0243 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.636390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-068097f5-e53c-4473-b855-d61066fa0243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.644592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 769/1556] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.645359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068097f5-e53c-4473-b855-d61066fa0243 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.650612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9b51d18a-b9ad-44f2-a8a7-d7f76b624533 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.652423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9b51d18a-b9ad-44f2-a8a7-d7f76b624533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.655338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068097f5-e53c-4473-b855-d61066fa0243 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.660200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2b16a-514c-4aad-9337-1b745eeae61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.660367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 788/1557] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.660799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2b16a-514c-4aad-9337-1b745eeae61c admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.661073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51d18a-b9ad-44f2-a8a7-d7f76b624533 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.661179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2b16a-514c-4aad-9337-1b745eeae61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.661343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2b16a-514c-4aad-9337-1b745eeae61c admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.662084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2b16a-514c-4aad-9337-1b745eeae61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.663129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-4ec2b16a-514c-4aad-9337-1b745eeae61c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:18:21.663129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: warnings.warn(msg) Sep 16 19:18:21.663129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: Sep 16 19:18:21.664348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2b16a-514c-4aad-9337-1b745eeae61c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.670772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51d18a-b9ad-44f2-a8a7-d7f76b624533 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.677668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83421bd4-c404-4406-bb66-5302d4ff2c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.678346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421bd4-c404-4406-bb66-5302d4ff2c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.678635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421bd4-c404-4406-bb66-5302d4ff2c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.678911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421bd4-c404-4406-bb66-5302d4ff2c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.679588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83421bd4-c404-4406-bb66-5302d4ff2c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.681659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83421bd4-c404-4406-bb66-5302d4ff2c2d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.684809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:21.694261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 770/1558] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:21.695681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51643b00-1e22-462c-89de-175deedb5929 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.695975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51643b00-1e22-462c-89de-175deedb5929 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.696264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51643b00-1e22-462c-89de-175deedb5929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.704766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:21.712721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 789/1559] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:21.713527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83421bd4-c404-4406-bb66-5302d4ff2c2d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.716984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-51643b00-1e22-462c-89de-175deedb5929 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.718189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-51643b00-1e22-462c-89de-175deedb5929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.778433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83421bd4-c404-4406-bb66-5302d4ff2c2d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.780343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 771/1560] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.781566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eae6e-5c63-44e0-acaa-80a096ac4e9e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.781856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eae6e-5c63-44e0-acaa-80a096ac4e9e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.782147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012eae6e-5c63-44e0-acaa-80a096ac4e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.783403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59d1a7-6c28-4195-b94a-28eda3692218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.784048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d1a7-6c28-4195-b94a-28eda3692218 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.784332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d1a7-6c28-4195-b94a-28eda3692218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.784606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d1a7-6c28-4195-b94a-28eda3692218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.785256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59d1a7-6c28-4195-b94a-28eda3692218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.786893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59d1a7-6c28-4195-b94a-28eda3692218 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.797745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 790/1561] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:21.799126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8fe4f-59a8-45e9-81f0-a09725cdc79d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.799409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8fe4f-59a8-45e9-81f0-a09725cdc79d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.800369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8fe4f-59a8-45e9-81f0-a09725cdc79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.802449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-012eae6e-5c63-44e0-acaa-80a096ac4e9e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.803690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-012eae6e-5c63-44e0-acaa-80a096ac4e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.811919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 772/1562] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.813098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8752-111e-494a-90d8-723c55449bad None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.813381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8752-111e-494a-90d8-723c55449bad None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.813657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c8752-111e-494a-90d8-723c55449bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.820513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9cc8fe4f-59a8-45e9-81f0-a09725cdc79d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.821714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9cc8fe4f-59a8-45e9-81f0-a09725cdc79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.829596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 791/1563] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.830443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8fe4f-59a8-45e9-81f0-a09725cdc79d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.833729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-112c8752-111e-494a-90d8-723c55449bad None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:21.834789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-112c8752-111e-494a-90d8-723c55449bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:21.841027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8fe4f-59a8-45e9-81f0-a09725cdc79d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.842730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 773/1564] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:21.845625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.846346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.847541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.847872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.848058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c8752-111e-494a-90d8-723c55449bad None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.848674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:21.848987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.850585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.857223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c8752-111e-494a-90d8-723c55449bad None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.861922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf591b0-2a25-49b9-8d7a-b2f379953fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.862638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 792/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:21.862866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf591b0-2a25-49b9-8d7a-b2f379953fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.863184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf591b0-2a25-49b9-8d7a-b2f379953fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.863443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.863541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf591b0-2a25-49b9-8d7a-b2f379953fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.864101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf591b0-2a25-49b9-8d7a-b2f379953fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.865703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf591b0-2a25-49b9-8d7a-b2f379953fe1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.876235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 774/1566] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:21.876973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf591b0-2a25-49b9-8d7a-b2f379953fe1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.879921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52354c7-0cb4-45e9-83ae-7e9187df7824 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.884680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624451a-5b80-431c-ae4b-9bebb2a9689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.885281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624451a-5b80-431c-ae4b-9bebb2a9689a admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.885564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624451a-5b80-431c-ae4b-9bebb2a9689a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.885842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624451a-5b80-431c-ae4b-9bebb2a9689a admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.886498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624451a-5b80-431c-ae4b-9bebb2a9689a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.887241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf591b0-2a25-49b9-8d7a-b2f379953fe1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.888465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624451a-5b80-431c-ae4b-9bebb2a9689a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.891888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.892472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.892756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.893035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.894493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:21.894799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.896398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.909046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 775/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:21.909631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.914591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 793/1568] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/users => generated 287 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:21.915541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624451a-5b80-431c-ae4b-9bebb2a9689a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.920879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade46fe-7090-46e7-aefc-1de25b1d66da admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.925501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624451a-5b80-431c-ae4b-9bebb2a9689a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.925821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa4f4-a579-4610-9560-ea9f5ac973d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.926497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa4f4-a579-4610-9560-ea9f5ac973d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.926783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa4f4-a579-4610-9560-ea9f5ac973d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.927143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0aa4f4-a579-4610-9560-ea9f5ac973d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.927811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa4f4-a579-4610-9560-ea9f5ac973d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.929386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0aa4f4-a579-4610-9560-ea9f5ac973d0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.930205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.930793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.931110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.931396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.932034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:21.932343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.933923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.943355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 776/1569] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:21.943355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa4f4-a579-4610-9560-ea9f5ac973d0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.950861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 794/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:21.950861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.958620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0aa4f4-a579-4610-9560-ea9f5ac973d0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.961332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c019c89-abd4-4f06-a017-483cfe51d636 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.963602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.964213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.964499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.964777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.965453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:21.965762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.965873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.966461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.966744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.967047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.967435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.967682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:21.968026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.969575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:21.980189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 777/1571] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:21.980965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.989602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 795/1572] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:21.990626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011417c3-c593-4fea-93df-d4e3ca6f8c0e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:21.991901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:21.995384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f411a-4a6e-4d6e-8062-9b1eec70015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:21.995979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f411a-4a6e-4d6e-8062-9b1eec70015f admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:21.996364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f411a-4a6e-4d6e-8062-9b1eec70015f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:21.996603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f411a-4a6e-4d6e-8062-9b1eec70015f admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:21.997456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f411a-4a6e-4d6e-8062-9b1eec70015f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:21.999919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f411a-4a6e-4d6e-8062-9b1eec70015f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.001717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608d07d-2257-4339-85ec-5e9f45f13e30 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.006969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3413c-fc34-4b9f-b64f-7b63dd54b9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.007587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3413c-fc34-4b9f-b64f-7b63dd54b9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.007872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3413c-fc34-4b9f-b64f-7b63dd54b9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.008147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3413c-fc34-4b9f-b64f-7b63dd54b9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.008788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3413c-fc34-4b9f-b64f-7b63dd54b9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.010356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3413c-fc34-4b9f-b64f-7b63dd54b9b9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.021192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 796/1573] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.024889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3413c-fc34-4b9f-b64f-7b63dd54b9b9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.030986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 778/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:21 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.031756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f411a-4a6e-4d6e-8062-9b1eec70015f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.031928 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3413c-fc34-4b9f-b64f-7b63dd54b9b9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.089063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fed9b-f79d-4b98-8044-7d9e7cd576a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.089681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fed9b-f79d-4b98-8044-7d9e7cd576a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.089958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fed9b-f79d-4b98-8044-7d9e7cd576a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.090230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fed9b-f79d-4b98-8044-7d9e7cd576a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.090873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fed9b-f79d-4b98-8044-7d9e7cd576a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.092506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fed9b-f79d-4b98-8044-7d9e7cd576a4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.094460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f411a-4a6e-4d6e-8062-9b1eec70015f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.100180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712177-4c8f-40de-97af-431a239c97b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.100817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712177-4c8f-40de-97af-431a239c97b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.101103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712177-4c8f-40de-97af-431a239c97b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.101379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9712177-4c8f-40de-97af-431a239c97b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.102013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9712177-4c8f-40de-97af-431a239c97b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.102477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 797/1575] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.103348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fed9b-f79d-4b98-8044-7d9e7cd576a4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.103972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9712177-4c8f-40de-97af-431a239c97b8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.113477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fed9b-f79d-4b98-8044-7d9e7cd576a4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.118521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.119375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.119599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.119945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] PATH_INFO: `/v3/projects/e3dfbe37504f4632af17f6ec95a9fdbb/users/047780e830d14ab8a1cdb9a6061cb939/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.133138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 779/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.133947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712177-4c8f-40de-97af-431a239c97b8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.136858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3dfbe37504f4632af17f6ec95a9fdbb, user_id=047780e830d14ab8a1cdb9a6061cb939, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.137901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:18:22.137901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: warnings.warn(msg) Sep 16 19:18:22.137901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: Sep 16 19:18:22.138185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:22.140315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.142612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:22.155154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 798/1577] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:22 2022] PUT /identity/v3/projects/e3dfbe37504f4632af17f6ec95a9fdbb/users/047780e830d14ab8a1cdb9a6061cb939/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:22.156012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.201081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9712177-4c8f-40de-97af-431a239c97b8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.218460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f8f6a-a44f-4c31-a750-5ae1e379c8a6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.223679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a0a31-a6a5-4630-872f-e812c45c7af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.224284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a0a31-a6a5-4630-872f-e812c45c7af8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.224571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a0a31-a6a5-4630-872f-e812c45c7af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.224843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a0a31-a6a5-4630-872f-e812c45c7af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.225478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a0a31-a6a5-4630-872f-e812c45c7af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.227415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a0a31-a6a5-4630-872f-e812c45c7af8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.259408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 799/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.259408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a0a31-a6a5-4630-872f-e812c45c7af8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.259882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e56cb8-234f-48aa-bf55-130f362f6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.260506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56cb8-234f-48aa-bf55-130f362f6e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.260788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56cb8-234f-48aa-bf55-130f362f6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.261069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e56cb8-234f-48aa-bf55-130f362f6e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.261723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e56cb8-234f-48aa-bf55-130f362f6e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.263656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e56cb8-234f-48aa-bf55-130f362f6e6b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.291999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 780/1579] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.296033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e56cb8-234f-48aa-bf55-130f362f6e6b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.322199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a0a31-a6a5-4630-872f-e812c45c7af8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.357177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e56cb8-234f-48aa-bf55-130f362f6e6b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.362663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856ce8e-8edd-449f-bd9e-89789c306787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.363531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ce8e-8edd-449f-bd9e-89789c306787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.363820 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ce8e-8edd-449f-bd9e-89789c306787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.364101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856ce8e-8edd-449f-bd9e-89789c306787 admin admin] PATH_INFO: `/v3/projects/90c27bc2b190423da4bf9406b50462c6/users/9a80fb7510eb4034bcbf610adb63e1a2/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.379522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856ce8e-8edd-449f-bd9e-89789c306787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c27bc2b190423da4bf9406b50462c6, user_id=9a80fb7510eb4034bcbf610adb63e1a2, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.380370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c1fb1-f272-4454-86c0-77c2858ef119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.381009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c1fb1-f272-4454-86c0-77c2858ef119 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.381272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c1fb1-f272-4454-86c0-77c2858ef119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.381546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c1fb1-f272-4454-86c0-77c2858ef119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.382166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856ce8e-8edd-449f-bd9e-89789c306787 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.382261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c1fb1-f272-4454-86c0-77c2858ef119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.384242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c1fb1-f272-4454-86c0-77c2858ef119 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.395323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 781/1580] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:22 2022] PUT /identity/v3/projects/90c27bc2b190423da4bf9406b50462c6/users/9a80fb7510eb4034bcbf610adb63e1a2/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:22.396483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856ce8e-8edd-449f-bd9e-89789c306787 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.418127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 800/1581] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/projects => generated 401 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.418127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c1fb1-f272-4454-86c0-77c2858ef119 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.418755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:22.428482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:22.464979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856ce8e-8edd-449f-bd9e-89789c306787 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.484167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c1fb1-f272-4454-86c0-77c2858ef119 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.489367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac807-fccc-4a61-a394-b98090f77a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.489976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac807-fccc-4a61-a394-b98090f77a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.490260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac807-fccc-4a61-a394-b98090f77a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.490536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac807-fccc-4a61-a394-b98090f77a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.491207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edac807-fccc-4a61-a394-b98090f77a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.492826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edac807-fccc-4a61-a394-b98090f77a5d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.503514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 801/1582] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.504348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac807-fccc-4a61-a394-b98090f77a5d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.514230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac807-fccc-4a61-a394-b98090f77a5d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.518946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514abec-28aa-4b54-8a28-5071cd717d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.519562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514abec-28aa-4b54-8a28-5071cd717d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.519847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514abec-28aa-4b54-8a28-5071cd717d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.520123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514abec-28aa-4b54-8a28-5071cd717d0b admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.520774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514abec-28aa-4b54-8a28-5071cd717d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.522668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514abec-28aa-4b54-8a28-5071cd717d0b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.524923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536b49a-8f14-4bc2-b4a7-26d16314abcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.525537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536b49a-8f14-4bc2-b4a7-26d16314abcb admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.525819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536b49a-8f14-4bc2-b4a7-26d16314abcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.526098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0536b49a-8f14-4bc2-b4a7-26d16314abcb admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.526725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536b49a-8f14-4bc2-b4a7-26d16314abcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.528648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0536b49a-8f14-4bc2-b4a7-26d16314abcb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.546350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 802/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.547543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65a41-d748-46ea-b6ca-06036fada212 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.547836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65a41-d748-46ea-b6ca-06036fada212 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.548091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d65a41-d748-46ea-b6ca-06036fada212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.554178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 782/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.554178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536b49a-8f14-4bc2-b4a7-26d16314abcb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.561934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0536b49a-8f14-4bc2-b4a7-26d16314abcb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.567318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fa730-e149-4665-acf4-3f68b349ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.567919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fa730-e149-4665-acf4-3f68b349ab6c admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.568206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fa730-e149-4665-acf4-3f68b349ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.568486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fa730-e149-4665-acf4-3f68b349ab6c admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.569113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fa730-e149-4665-acf4-3f68b349ab6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.571034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fa730-e149-4665-acf4-3f68b349ab6c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.571613 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e4d65a41-d748-46ea-b6ca-06036fada212 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:22.572806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e4d65a41-d748-46ea-b6ca-06036fada212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:22.580556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 803/1585] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:22.581353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d65a41-d748-46ea-b6ca-06036fada212 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.593395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d65a41-d748-46ea-b6ca-06036fada212 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.599563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 783/1586] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.599563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40140f-a8a1-4b76-b890-003a870fe90a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.599563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40140f-a8a1-4b76-b890-003a870fe90a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.599563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40140f-a8a1-4b76-b890-003a870fe90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.601642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b2ec1-df10-4e0d-8548-759de9389abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.602379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2ec1-df10-4e0d-8548-759de9389abb admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.602662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2ec1-df10-4e0d-8548-759de9389abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.602934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b2ec1-df10-4e0d-8548-759de9389abb admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.603606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b2ec1-df10-4e0d-8548-759de9389abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.605526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b2ec1-df10-4e0d-8548-759de9389abb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.617868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0b40140f-a8a1-4b76-b890-003a870fe90a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:22.619151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0b40140f-a8a1-4b76-b890-003a870fe90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:22.627372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 784/1587] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:22.627573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 804/1588] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.628844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40140f-a8a1-4b76-b890-003a870fe90a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.629329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b2ec1-df10-4e0d-8548-759de9389abb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.639900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40140f-a8a1-4b76-b890-003a870fe90a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.640068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b2ec1-df10-4e0d-8548-759de9389abb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.644667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61141c81-0269-47ce-84ad-69f9a33173e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.645025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d90f8-4480-46b2-9233-d6561a69d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.645274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141c81-0269-47ce-84ad-69f9a33173e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.645559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141c81-0269-47ce-84ad-69f9a33173e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.645668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d90f8-4480-46b2-9233-d6561a69d92b admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.645833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61141c81-0269-47ce-84ad-69f9a33173e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.645941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d90f8-4480-46b2-9233-d6561a69d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.646203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d90f8-4480-46b2-9233-d6561a69d92b admin admin] PATH_INFO: `/v3/projects/92626aff5f5c45b19b88e2f8ecdee14c/users/f1e2bb05545145a9b384ae2457e9c3bd/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.646467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61141c81-0269-47ce-84ad-69f9a33173e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.648420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61141c81-0269-47ce-84ad-69f9a33173e9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.662407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d90f8-4480-46b2-9233-d6561a69d92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92626aff5f5c45b19b88e2f8ecdee14c, user_id=f1e2bb05545145a9b384ae2457e9c3bd, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.665099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d90f8-4480-46b2-9233-d6561a69d92b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.670760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 785/1589] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/users => generated 301 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:22.671640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61141c81-0269-47ce-84ad-69f9a33173e9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.680562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 805/1590] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:22 2022] PUT /identity/v3/projects/92626aff5f5c45b19b88e2f8ecdee14c/users/f1e2bb05545145a9b384ae2457e9c3bd/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:22.681368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d90f8-4480-46b2-9233-d6561a69d92b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.682673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61141c81-0269-47ce-84ad-69f9a33173e9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.747379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174bbc7-6bae-467d-9c02-b67d4752f72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.748006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174bbc7-6bae-467d-9c02-b67d4752f72f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.748314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174bbc7-6bae-467d-9c02-b67d4752f72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.748566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174bbc7-6bae-467d-9c02-b67d4752f72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.749208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174bbc7-6bae-467d-9c02-b67d4752f72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.750889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174bbc7-6bae-467d-9c02-b67d4752f72f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.751740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d90f8-4480-46b2-9233-d6561a69d92b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.756906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fb91-c205-420d-b8a3-62ff9d0f0ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.757510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fb91-c205-420d-b8a3-62ff9d0f0ead admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.757793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fb91-c205-420d-b8a3-62ff9d0f0ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.758077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0fb91-c205-420d-b8a3-62ff9d0f0ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.758720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0fb91-c205-420d-b8a3-62ff9d0f0ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.760385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0fb91-c205-420d-b8a3-62ff9d0f0ead admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.761941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 786/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.762753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174bbc7-6bae-467d-9c02-b67d4752f72f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.771905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 806/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.772720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fb91-c205-420d-b8a3-62ff9d0f0ead admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.773651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:22.783863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0fb91-c205-420d-b8a3-62ff9d0f0ead admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.788385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf6f24-d72c-4dde-ae49-95f39b4df0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.788975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf6f24-d72c-4dde-ae49-95f39b4df0ee admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.789258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf6f24-d72c-4dde-ae49-95f39b4df0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.789536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf6f24-d72c-4dde-ae49-95f39b4df0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.790192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf6f24-d72c-4dde-ae49-95f39b4df0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.791810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf6f24-d72c-4dde-ae49-95f39b4df0ee admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.801790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 807/1593] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.802625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf6f24-d72c-4dde-ae49-95f39b4df0ee admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.812548 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf6f24-d72c-4dde-ae49-95f39b4df0ee admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.817778 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.818399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.818686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.818961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.819640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.821214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.821976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174bbc7-6bae-467d-9c02-b67d4752f72f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.825519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab30c5-1ee5-421e-ae14-33a721517b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.826119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab30c5-1ee5-421e-ae14-33a721517b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.826397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab30c5-1ee5-421e-ae14-33a721517b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.826670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab30c5-1ee5-421e-ae14-33a721517b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.832495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 808/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.833282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.834893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:22.839034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab30c5-1ee5-421e-ae14-33a721517b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.840706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab30c5-1ee5-421e-ae14-33a721517b75 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.846171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58b821-da28-4a35-ad9f-4ad851255c71 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.850292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167831b-0d87-4d83-86b3-4e1c99bcc37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.850825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 787/1595] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:22.851080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167831b-0d87-4d83-86b3-4e1c99bcc37f service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.851263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167831b-0d87-4d83-86b3-4e1c99bcc37f service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.851537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167831b-0d87-4d83-86b3-4e1c99bcc37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.851664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab30c5-1ee5-421e-ae14-33a721517b75 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.860986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab30c5-1ee5-421e-ae14-33a721517b75 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.861233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167831b-0d87-4d83-86b3-4e1c99bcc37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.862681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167831b-0d87-4d83-86b3-4e1c99bcc37f service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.866098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2dffd-d002-436e-85ca-c6780f164aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.866755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2dffd-d002-436e-85ca-c6780f164aac admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.867075 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2dffd-d002-436e-85ca-c6780f164aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.867416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2dffd-d002-436e-85ca-c6780f164aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.868113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2dffd-d002-436e-85ca-c6780f164aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.869695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2dffd-d002-436e-85ca-c6780f164aac admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.872992 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 809/1596] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:22.874083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5e1a7-f8e5-469a-905b-4fcce6c08d21 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.874453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5e1a7-f8e5-469a-905b-4fcce6c08d21 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.874648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5e1a7-f8e5-469a-905b-4fcce6c08d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.884420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 788/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.884420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2dffd-d002-436e-85ca-c6780f164aac admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.887187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:22.897706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2dffd-d002-436e-85ca-c6780f164aac admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.903340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486396-91b8-477e-a7ac-24d0a7b13355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.904009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486396-91b8-477e-a7ac-24d0a7b13355 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.904294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486396-91b8-477e-a7ac-24d0a7b13355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.904572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7486396-91b8-477e-a7ac-24d0a7b13355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.905273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7486396-91b8-477e-a7ac-24d0a7b13355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.907075 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7486396-91b8-477e-a7ac-24d0a7b13355 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.915590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e2a5e1a7-f8e5-469a-905b-4fcce6c08d21 None None] MFA Rules not processed for user `f1e2bb05545145a9b384ae2457e9c3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:22.917410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e2a5e1a7-f8e5-469a-905b-4fcce6c08d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:22.919707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 789/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.920738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486396-91b8-477e-a7ac-24d0a7b13355 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.934986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7486396-91b8-477e-a7ac-24d0a7b13355 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.946355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd84d8-43c9-4534-82b4-b96589bf5ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.947551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd84d8-43c9-4534-82b4-b96589bf5ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.948159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd84d8-43c9-4534-82b4-b96589bf5ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.948765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd84d8-43c9-4534-82b4-b96589bf5ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:22.950477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd84d8-43c9-4534-82b4-b96589bf5ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:22.953299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd84d8-43c9-4534-82b4-b96589bf5ebf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:22.973838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 790/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:22.975200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd84d8-43c9-4534-82b4-b96589bf5ebf admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:22.990529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd84d8-43c9-4534-82b4-b96589bf5ebf admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:22.997950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a2955-9725-43ff-aed0-5f1a23d58375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:22.998624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2955-9725-43ff-aed0-5f1a23d58375 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:22.998970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2955-9725-43ff-aed0-5f1a23d58375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:22.999415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a2955-9725-43ff-aed0-5f1a23d58375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.000738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a2955-9725-43ff-aed0-5f1a23d58375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.002541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a2955-9725-43ff-aed0-5f1a23d58375 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.018883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 791/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:23.018883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a2955-9725-43ff-aed0-5f1a23d58375 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.025945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 810/1601] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:23.025945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5e1a7-f8e5-469a-905b-4fcce6c08d21 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.028905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a2955-9725-43ff-aed0-5f1a23d58375 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:23.035446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fdabb-48cb-445e-af11-3f5e77d7e421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:23.036112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fdabb-48cb-445e-af11-3f5e77d7e421 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.036326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fdabb-48cb-445e-af11-3f5e77d7e421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.037033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fdabb-48cb-445e-af11-3f5e77d7e421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.037695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fdabb-48cb-445e-af11-3f5e77d7e421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.037983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5e1a7-f8e5-469a-905b-4fcce6c08d21 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:23.039770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fdabb-48cb-445e-af11-3f5e77d7e421 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.043534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff9ad-4027-4cb6-8b7d-b699a1bded79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:23.044304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff9ad-4027-4cb6-8b7d-b699a1bded79 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.044843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff9ad-4027-4cb6-8b7d-b699a1bded79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.045189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff9ad-4027-4cb6-8b7d-b699a1bded79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.046501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ff9ad-4027-4cb6-8b7d-b699a1bded79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.049028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ff9ad-4027-4cb6-8b7d-b699a1bded79 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.058594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 792/1602] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:23.058594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fdabb-48cb-445e-af11-3f5e77d7e421 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.084551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fdabb-48cb-445e-af11-3f5e77d7e421 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:23.093793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 811/1603] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:23.094939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff9ad-4027-4cb6-8b7d-b699a1bded79 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.099225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0beeea-7d87-4129-8c7d-d508837c225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:23.102607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0beeea-7d87-4129-8c7d-d508837c225a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.103158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0beeea-7d87-4129-8c7d-d508837c225a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.105185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0beeea-7d87-4129-8c7d-d508837c225a admin admin] PATH_INFO: `/v3/projects/36913be5315d486293e469c928e6e4ec/users/0522e5c104c54f75b249ec924b0b08d3/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.129006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff9ad-4027-4cb6-8b7d-b699a1bded79 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:23.135155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d08d-5426-462c-9c83-52756cb8d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:23.136093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d08d-5426-462c-9c83-52756cb8d64e admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.136384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d08d-5426-462c-9c83-52756cb8d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.136667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d08d-5426-462c-9c83-52756cb8d64e admin admin] PATH_INFO: `/v3/projects/71f4028a90274463b03bae2927d07e33/users/383da3d0374e4b6b9e44aad1c58bc213/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.140358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0beeea-7d87-4129-8c7d-d508837c225a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36913be5315d486293e469c928e6e4ec, user_id=0522e5c104c54f75b249ec924b0b08d3, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.144234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0beeea-7d87-4129-8c7d-d508837c225a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.161415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9d08d-5426-462c-9c83-52756cb8d64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f4028a90274463b03bae2927d07e33, user_id=383da3d0374e4b6b9e44aad1c58bc213, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.164154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 793/1604] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:23 2022] PUT /identity/v3/projects/36913be5315d486293e469c928e6e4ec/users/0522e5c104c54f75b249ec924b0b08d3/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:23.164728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9d08d-5426-462c-9c83-52756cb8d64e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.165192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0beeea-7d87-4129-8c7d-d508837c225a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.184476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 812/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:23 2022] PUT /identity/v3/projects/71f4028a90274463b03bae2927d07e33/users/383da3d0374e4b6b9e44aad1c58bc213/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:23.185671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d08d-5426-462c-9c83-52756cb8d64e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.249596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0beeea-7d87-4129-8c7d-d508837c225a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:23.277036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d08d-5426-462c-9c83-52756cb8d64e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:23.283372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7990d-b780-4e24-872b-d456947fe0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:23.284790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7990d-b780-4e24-872b-d456947fe0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.285235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7990d-b780-4e24-872b-d456947fe0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.285611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7990d-b780-4e24-872b-d456947fe0ef admin admin] PATH_INFO: `/v3/projects/ab7de5a941044b50bd04bfce3ecd8b8c/users/d42e398d2c514b7fb64fd6e7a42847a0/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.302476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:23.305709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7990d-b780-4e24-872b-d456947fe0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7de5a941044b50bd04bfce3ecd8b8c, user_id=d42e398d2c514b7fb64fd6e7a42847a0, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.310348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7990d-b780-4e24-872b-d456947fe0ef admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.326748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713f64c-1cd0-43ca-b6c4-b2999588ea2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:23.327474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f64c-1cd0-43ca-b6c4-b2999588ea2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.327813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f64c-1cd0-43ca-b6c4-b2999588ea2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.328088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713f64c-1cd0-43ca-b6c4-b2999588ea2d admin admin] PATH_INFO: `/v3/projects/e95334212c8841d98db895c351fbfdfe/users/1e53d46902444c0fb0ab0e56960ff8c2/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.329128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 813/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:23 2022] PUT /identity/v3/projects/ab7de5a941044b50bd04bfce3ecd8b8c/users/d42e398d2c514b7fb64fd6e7a42847a0/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:23.330604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5542b1-61fe-444d-8bd8-f3cba99c9d07 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.331437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5542b1-61fe-444d-8bd8-f3cba99c9d07 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.331891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5542b1-61fe-444d-8bd8-f3cba99c9d07 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.333556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 814/1607] 10.222.0.20 () {54 vars in 965 bytes} [Fri Sep 16 19:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:23.334331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5542b1-61fe-444d-8bd8-f3cba99c9d07 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.356200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713f64c-1cd0-43ca-b6c4-b2999588ea2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95334212c8841d98db895c351fbfdfe, user_id=1e53d46902444c0fb0ab0e56960ff8c2, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.359269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713f64c-1cd0-43ca-b6c4-b2999588ea2d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.382969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 794/1608] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:23 2022] PUT /identity/v3/projects/e95334212c8841d98db895c351fbfdfe/users/1e53d46902444c0fb0ab0e56960ff8c2/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:23.382969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a667-291a-4914-8a5d-beafc5b97fec None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.382969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a667-291a-4914-8a5d-beafc5b97fec None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.382969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237a667-291a-4914-8a5d-beafc5b97fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.391769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:23.404390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2237a667-291a-4914-8a5d-beafc5b97fec None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:23.406189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2237a667-291a-4914-8a5d-beafc5b97fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:23.419865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5542b1-61fe-444d-8bd8-f3cba99c9d07 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:23.522024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 795/1609] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:23.523706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b53eb-9661-4fde-8a26-0ce7cebc7984 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.524103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b53eb-9661-4fde-8a26-0ce7cebc7984 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.524261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b53eb-9661-4fde-8a26-0ce7cebc7984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.553462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e4698-9f95-44d1-b2e3-51239a538f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:23.554567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e4698-9f95-44d1-b2e3-51239a538f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.555067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e4698-9f95-44d1-b2e3-51239a538f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.555355 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e4698-9f95-44d1-b2e3-51239a538f60 admin admin] PATH_INFO: `/v3/projects/9f54bcb066ad42e0bdcbd24322249bb5/users/3b30e32aa9ed462a95d348a607849d71/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.560636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cd1b53eb-9661-4fde-8a26-0ce7cebc7984 None None] MFA Rules not processed for user `383da3d0374e4b6b9e44aad1c58bc213`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:23.562414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cd1b53eb-9661-4fde-8a26-0ce7cebc7984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:23.584270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e4698-9f95-44d1-b2e3-51239a538f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f54bcb066ad42e0bdcbd24322249bb5, user_id=3b30e32aa9ed462a95d348a607849d71, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.588071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e4698-9f95-44d1-b2e3-51239a538f60 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.613184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 815/1610] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:23 2022] PUT /identity/v3/projects/9f54bcb066ad42e0bdcbd24322249bb5/users/3b30e32aa9ed462a95d348a607849d71/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:23.614831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213f30d-2ee2-4190-a5e6-3532a923284d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.615364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213f30d-2ee2-4190-a5e6-3532a923284d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.615906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213f30d-2ee2-4190-a5e6-3532a923284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.654772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c213f30d-2ee2-4190-a5e6-3532a923284d None None] MFA Rules not processed for user `d42e398d2c514b7fb64fd6e7a42847a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:23.656359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c213f30d-2ee2-4190-a5e6-3532a923284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:23.664793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 796/1611] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:23.664793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ae8e-65ae-4600-91ba-c1aa0a4e5ae3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.664793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ae8e-65ae-4600-91ba-c1aa0a4e5ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.664793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310ae8e-65ae-4600-91ba-c1aa0a4e5ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.710541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e310ae8e-65ae-4600-91ba-c1aa0a4e5ae3 None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:23.711978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e310ae8e-65ae-4600-91ba-c1aa0a4e5ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:23.753208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 816/1612] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:23.753940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:23.755622 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb66f-44c5-4d59-ba69-1400224d5bec None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.755977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb66f-44c5-4d59-ba69-1400224d5bec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.756258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abb66f-44c5-4d59-ba69-1400224d5bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.785887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-41abb66f-44c5-4d59-ba69-1400224d5bec None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:23.787336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-41abb66f-44c5-4d59-ba69-1400224d5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:23.810557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 797/1613] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Sep 16 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:23.816258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310ae8e-65ae-4600-91ba-c1aa0a4e5ae3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.898682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:23.922796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 817/1614] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:23.922796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f74ca-627c-4ea2-8d84-b6107cd680b5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.922796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f74ca-627c-4ea2-8d84-b6107cd680b5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.922796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f74ca-627c-4ea2-8d84-b6107cd680b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.934099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310ae8e-65ae-4600-91ba-c1aa0a4e5ae3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:23.938173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed9954-971e-478f-9222-b6b33b3af1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:23.944305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed9954-971e-478f-9222-b6b33b3af1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:23.944305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed9954-971e-478f-9222-b6b33b3af1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:23.944305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed9954-971e-478f-9222-b6b33b3af1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:23.952401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed9954-971e-478f-9222-b6b33b3af1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:23.954058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed9954-971e-478f-9222-b6b33b3af1a0 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:23.970669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 798/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:23.971389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4b9f74ca-627c-4ea2-8d84-b6107cd680b5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:23.972396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed9954-971e-478f-9222-b6b33b3af1a0 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:23.973213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4b9f74ca-627c-4ea2-8d84-b6107cd680b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:23.999635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 818/1616] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:24.001761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77cd8-f258-4197-8a88-5776b5bc867c None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.002124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77cd8-f258-4197-8a88-5776b5bc867c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.003628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77cd8-f258-4197-8a88-5776b5bc867c None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.004856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 819/1617] 10.222.0.20 () {54 vars in 965 bytes} [Fri Sep 16 19:18:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:24.005583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f77cd8-f258-4197-8a88-5776b5bc867c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:24.023473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f77cd8-f258-4197-8a88-5776b5bc867c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:24.032829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017baa6e-f64c-4eb2-972a-98b3a2916f19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:24.034341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017baa6e-f64c-4eb2-972a-98b3a2916f19 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.034801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017baa6e-f64c-4eb2-972a-98b3a2916f19 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.036083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017baa6e-f64c-4eb2-972a-98b3a2916f19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.083111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed9954-971e-478f-9222-b6b33b3af1a0 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:24.088267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c5e9a-334c-4d35-8b69-2a162d7a247b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:24.089169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5e9a-334c-4d35-8b69-2a162d7a247b service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.089606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5e9a-334c-4d35-8b69-2a162d7a247b service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.090225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c5e9a-334c-4d35-8b69-2a162d7a247b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.149575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017baa6e-f64c-4eb2-972a-98b3a2916f19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:24.154616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017baa6e-f64c-4eb2-972a-98b3a2916f19 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:24.179241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 820/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:24.180207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017baa6e-f64c-4eb2-972a-98b3a2916f19 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:24.196424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c5e9a-334c-4d35-8b69-2a162d7a247b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:24.199496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c5e9a-334c-4d35-8b69-2a162d7a247b service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:24.204859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017baa6e-f64c-4eb2-972a-98b3a2916f19 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:24.213255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212fcc-ffdc-4a9b-b2ba-b5174031fa9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:24.213964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212fcc-ffdc-4a9b-b2ba-b5174031fa9f service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.214315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212fcc-ffdc-4a9b-b2ba-b5174031fa9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.214658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212fcc-ffdc-4a9b-b2ba-b5174031fa9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.216431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 799/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:24.233953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61699a7-8b0e-4223-8e78-dca8c545080d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.234954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61699a7-8b0e-4223-8e78-dca8c545080d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.239391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61699a7-8b0e-4223-8e78-dca8c545080d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.257889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6212fcc-ffdc-4a9b-b2ba-b5174031fa9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:24.260923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6212fcc-ffdc-4a9b-b2ba-b5174031fa9f service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:24.298720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 821/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:24.300927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212fcc-ffdc-4a9b-b2ba-b5174031fa9f service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:24.305338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b61699a7-8b0e-4223-8e78-dca8c545080d None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:24.315766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b61699a7-8b0e-4223-8e78-dca8c545080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:24.335628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212fcc-ffdc-4a9b-b2ba-b5174031fa9f service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:24.344296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 800/1621] 10.222.0.20 () {58 vars in 1062 bytes} [Fri Sep 16 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:24.355650 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c938a7f-0455-4434-abba-41bd90b6b0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:24.356706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938a7f-0455-4434-abba-41bd90b6b0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.357967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61699a7-8b0e-4223-8e78-dca8c545080d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:24.358463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938a7f-0455-4434-abba-41bd90b6b0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.358916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938a7f-0455-4434-abba-41bd90b6b0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.392891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61699a7-8b0e-4223-8e78-dca8c545080d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:24.394562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c938a7f-0455-4434-abba-41bd90b6b0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:24.397240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c938a7f-0455-4434-abba-41bd90b6b0b7 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:24.419645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa01a42-d6ff-4c56-8aa7-04229e2c36be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:24.421107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa01a42-d6ff-4c56-8aa7-04229e2c36be service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.421583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa01a42-d6ff-4c56-8aa7-04229e2c36be service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.422059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa01a42-d6ff-4c56-8aa7-04229e2c36be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.435344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 822/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:24.443162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa01a42-d6ff-4c56-8aa7-04229e2c36be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:24.444981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa01a42-d6ff-4c56-8aa7-04229e2c36be service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:24.476798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 801/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:24.607126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606933c-f686-4ab3-ba8d-99c56d7ee9ca None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.607382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606933c-f686-4ab3-ba8d-99c56d7ee9ca None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.607580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606933c-f686-4ab3-ba8d-99c56d7ee9ca None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.609754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 823/1624] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 16 19:18:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:24.617088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80bf1-d58d-40cf-a161-1f7c0fb95cee None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.618006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80bf1-d58d-40cf-a161-1f7c0fb95cee None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.618006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80bf1-d58d-40cf-a161-1f7c0fb95cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.652148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c1f80bf1-d58d-40cf-a161-1f7c0fb95cee None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:24.654081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c1f80bf1-d58d-40cf-a161-1f7c0fb95cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:24.684685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 802/1625] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:24.713641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606933c-f686-4ab3-ba8d-99c56d7ee9ca None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:24.733152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606933c-f686-4ab3-ba8d-99c56d7ee9ca None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:24.744936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86bdca-f484-4723-ad9e-6b177a25db47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:24.747101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86bdca-f484-4723-ad9e-6b177a25db47 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:24.747445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86bdca-f484-4723-ad9e-6b177a25db47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:24.747742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86bdca-f484-4723-ad9e-6b177a25db47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:24.779752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86bdca-f484-4723-ad9e-6b177a25db47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:24.781381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86bdca-f484-4723-ad9e-6b177a25db47 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:24.796638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 824/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:25.120244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c0bbe-e9b2-435b-8829-adc37d774b72 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:25.120721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c0bbe-e9b2-435b-8829-adc37d774b72 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:25.121098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c0bbe-e9b2-435b-8829-adc37d774b72 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:25.123069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 803/1627] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 16 19:18:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:25.135458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739289-8eea-4b69-8245-6753ebcf1f32 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:25.135922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739289-8eea-4b69-8245-6753ebcf1f32 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:25.136282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739289-8eea-4b69-8245-6753ebcf1f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:25.162573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c0bbe-e9b2-435b-8829-adc37d774b72 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:25.172650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:25.194465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c0bbe-e9b2-435b-8829-adc37d774b72 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:25.215615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:25.218243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:25.218632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:25.219578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] PATH_INFO: `/v3/users/f1e2bb05545145a9b384ae2457e9c3bd` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:25.225300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e2bb05545145a9b384ae2457e9c3bd)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:25.235612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:25.237541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-af739289-8eea-4b69-8245-6753ebcf1f32 None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:25.238658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-af739289-8eea-4b69-8245-6753ebcf1f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:25.276822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 825/1628] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:25.298420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af739289-8eea-4b69-8245-6753ebcf1f32 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:25.310746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af739289-8eea-4b69-8245-6753ebcf1f32 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:25.318605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418708f-771f-4bd0-bf3c-eb84bc435e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:25.319601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418708f-771f-4bd0-bf3c-eb84bc435e4a service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:25.320088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418708f-771f-4bd0-bf3c-eb84bc435e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:25.320562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418708f-771f-4bd0-bf3c-eb84bc435e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:25.344391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418708f-771f-4bd0-bf3c-eb84bc435e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:25.348989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418708f-771f-4bd0-bf3c-eb84bc435e4a service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:25.362719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e2bb05545145a9b384ae2457e9c3bd'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:25.374858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 826/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:25.390214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e2bb05545145a9b384ae2457e9c3bd'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:25.391081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e2bb05545145a9b384ae2457e9c3bd'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:25.392045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e2bb05545145a9b384ae2457e9c3bd'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:25.413554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e2bb05545145a9b384ae2457e9c3bd'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:25.458984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580e41-2026-41fe-95d6-e5b0f96d1197 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:25.459283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580e41-2026-41fe-95d6-e5b0f96d1197 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:25.460025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb580e41-2026-41fe-95d6-e5b0f96d1197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:25.463406 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 804/1630] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:25 2022] DELETE /identity/v3/users/f1e2bb05545145a9b384ae2457e9c3bd => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:25.497959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cb580e41-2026-41fe-95d6-e5b0f96d1197 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:25.500623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cb580e41-2026-41fe-95d6-e5b0f96d1197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:25.690158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 827/1631] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:25.713771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:25.715544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:25.871791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49a50d-2585-4422-98fd-977ae36716c9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:25.888647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:25.891150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:25.891550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:25.891827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:25.921722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:25.923941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:25.952463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 805/1632] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:18:29.160989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580e41-2026-41fe-95d6-e5b0f96d1197 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:29.162674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cb580e41-2026-41fe-95d6-e5b0f96d1197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:29.194498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb580e41-2026-41fe-95d6-e5b0f96d1197 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:29.204570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:29.206586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:29.218847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:29.220291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:29.220800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:29.221391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] PATH_INFO: `/v3/projects/92626aff5f5c45b19b88e2f8ecdee14c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:29.223672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92626aff5f5c45b19b88e2f8ecdee14c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:29.225977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:29.231640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ec401-4245-4990-8b5d-b57d4692c558 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:29.250393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:29.251247 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:29.251526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:29.251810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] PATH_INFO: `/v3/users/d42e398d2c514b7fb64fd6e7a42847a0` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:29.255976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42e398d2c514b7fb64fd6e7a42847a0)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:29.257439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:29.297679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:29.331737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92626aff5f5c45b19b88e2f8ecdee14c', 'request_id': 'req-f0c884da-2a07-4db4-ba1a-89d720332989'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.344258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92626aff5f5c45b19b88e2f8ecdee14c', 'request_id': 'req-f0c884da-2a07-4db4-ba1a-89d720332989'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.361133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92626aff5f5c45b19b88e2f8ecdee14c', 'request_id': 'req-f0c884da-2a07-4db4-ba1a-89d720332989'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.401702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] The token cache is being invalidate because project 92626aff5f5c45b19b88e2f8ecdee14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:29.401991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.403894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f0c884da-2a07-4db4-ba1a-89d720332989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.407053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42e398d2c514b7fb64fd6e7a42847a0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.414151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 828/1633] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:29 2022] DELETE /identity/v3/projects/92626aff5f5c45b19b88e2f8ecdee14c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:29.418723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350d649-a902-41a9-8798-b9822fea8b3b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:29.419044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350d649-a902-41a9-8798-b9822fea8b3b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:29.421736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42e398d2c514b7fb64fd6e7a42847a0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.422025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350d649-a902-41a9-8798-b9822fea8b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:29.427463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42e398d2c514b7fb64fd6e7a42847a0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.428404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42e398d2c514b7fb64fd6e7a42847a0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.463333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-88094164-9ff6-48dd-8455-0a4e9aae1708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42e398d2c514b7fb64fd6e7a42847a0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:29.481605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:29.484197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b350d649-a902-41a9-8798-b9822fea8b3b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:29.488420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b350d649-a902-41a9-8798-b9822fea8b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:29.522005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 806/1634] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:29 2022] DELETE /identity/v3/users/d42e398d2c514b7fb64fd6e7a42847a0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:29.524480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028103f-7822-4f37-9ece-7d4f968926b7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:29.524918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028103f-7822-4f37-9ece-7d4f968926b7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:29.525359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028103f-7822-4f37-9ece-7d4f968926b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:29.577254 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e028103f-7822-4f37-9ece-7d4f968926b7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:29.578702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e028103f-7822-4f37-9ece-7d4f968926b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:29.653685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 829/1635] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:29.662127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634bd91-51da-4248-a481-64313ec62e16 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:29.662747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634bd91-51da-4248-a481-64313ec62e16 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:29.663392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634bd91-51da-4248-a481-64313ec62e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:29.704617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6634bd91-51da-4248-a481-64313ec62e16 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:29.706854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6634bd91-51da-4248-a481-64313ec62e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:29.747045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 807/1636] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:29.869311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028103f-7822-4f37-9ece-7d4f968926b7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:29.871269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e028103f-7822-4f37-9ece-7d4f968926b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:29.886189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 830/1637] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:29.891655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634bd91-51da-4248-a481-64313ec62e16 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:29.919137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634bd91-51da-4248-a481-64313ec62e16 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:29.932032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:29.933965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:29.935130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:29.936418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:29.937580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:29.937895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:29.943445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:29.986885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028103f-7822-4f37-9ece-7d4f968926b7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:29.990856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 831/1638] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:29.991718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde921-170f-4fab-b49e-71b9f31293d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:29.992409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde921-170f-4fab-b49e-71b9f31293d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:29.992751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde921-170f-4fab-b49e-71b9f31293d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:29.993089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbde921-170f-4fab-b49e-71b9f31293d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:29.995174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:30.009138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbde921-170f-4fab-b49e-71b9f31293d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:30.010852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbde921-170f-4fab-b49e-71b9f31293d9 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:30.022981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 808/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:18:30.033489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b7540-cee8-4bd6-a487-358df3011ee6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:30.051900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa0ae1-1c8c-4d66-9a2e-8f44ba65e3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:30.052534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0ae1-1c8c-4d66-9a2e-8f44ba65e3cd admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:30.052811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0ae1-1c8c-4d66-9a2e-8f44ba65e3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:30.053081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa0ae1-1c8c-4d66-9a2e-8f44ba65e3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:30.054051 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa0ae1-1c8c-4d66-9a2e-8f44ba65e3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:30.059978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa0ae1-1c8c-4d66-9a2e-8f44ba65e3cd admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:30.142730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 832/1640] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:29 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:30.144670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde921-170f-4fab-b49e-71b9f31293d9 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:30.162089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbde921-170f-4fab-b49e-71b9f31293d9 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:30.322282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafffae-1cd3-40eb-8785-4318e959bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:30.322955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafffae-1cd3-40eb-8785-4318e959bb64 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:30.323190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafffae-1cd3-40eb-8785-4318e959bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:30.323508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafffae-1cd3-40eb-8785-4318e959bb64 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:30.332970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafffae-1cd3-40eb-8785-4318e959bb64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:30.338360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafffae-1cd3-40eb-8785-4318e959bb64 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:30.389727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 809/1641] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:30 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:30.394440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa0ae1-1c8c-4d66-9a2e-8f44ba65e3cd admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:30.411888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa0ae1-1c8c-4d66-9a2e-8f44ba65e3cd admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:30.419884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19588973-ca20-4d32-adbb-56dfb58d0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:30.420887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19588973-ca20-4d32-adbb-56dfb58d0af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:30.421173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19588973-ca20-4d32-adbb-56dfb58d0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:30.421539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19588973-ca20-4d32-adbb-56dfb58d0af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:30.422248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19588973-ca20-4d32-adbb-56dfb58d0af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:30.441614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19588973-ca20-4d32-adbb-56dfb58d0af5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:30.503669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 833/1642] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:30.506535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafffae-1cd3-40eb-8785-4318e959bb64 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:30.518920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafffae-1cd3-40eb-8785-4318e959bb64 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:30.536097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab08e9-fe66-429e-b42c-76bd7aeb0390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:30.536929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab08e9-fe66-429e-b42c-76bd7aeb0390 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:30.537382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab08e9-fe66-429e-b42c-76bd7aeb0390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:30.537799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab08e9-fe66-429e-b42c-76bd7aeb0390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:30.538638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab08e9-fe66-429e-b42c-76bd7aeb0390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:30.540443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab08e9-fe66-429e-b42c-76bd7aeb0390 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:30.547457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716192-aa94-4c46-92cb-56dfefc1085f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:30.548496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716192-aa94-4c46-92cb-56dfefc1085f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:30.548920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716192-aa94-4c46-92cb-56dfefc1085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:30.601696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 810/1643] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:30.605171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab08e9-fe66-429e-b42c-76bd7aeb0390 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:30.626504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:30.653980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab08e9-fe66-429e-b42c-76bd7aeb0390 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:30.656415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-00716192-aa94-4c46-92cb-56dfefc1085f None None] MFA Rules not processed for user `3b30e32aa9ed462a95d348a607849d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:30.661416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-00716192-aa94-4c46-92cb-56dfefc1085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:30.669631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f8128-9031-44f3-a091-b82337b0a528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:30.675275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f8128-9031-44f3-a091-b82337b0a528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:30.675778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f8128-9031-44f3-a091-b82337b0a528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:30.676468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f8128-9031-44f3-a091-b82337b0a528 admin admin] PATH_INFO: `/v3/projects/61f3809143a045dda2968dbbcbc58138/users/f8f1965c186d4af194c85e498edc168f/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:30.716491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:30.747509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f8128-9031-44f3-a091-b82337b0a528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f3809143a045dda2968dbbcbc58138, user_id=f8f1965c186d4af194c85e498edc168f, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:30.755981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f8128-9031-44f3-a091-b82337b0a528 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:30.798014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 811/1644] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:30 2022] PUT /identity/v3/projects/61f3809143a045dda2968dbbcbc58138/users/f8f1965c186d4af194c85e498edc168f/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:30.815720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346912c6-3eed-4cd8-a691-af7b1e1ce22d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:30.815720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346912c6-3eed-4cd8-a691-af7b1e1ce22d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:30.816229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346912c6-3eed-4cd8-a691-af7b1e1ce22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:30.879509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-346912c6-3eed-4cd8-a691-af7b1e1ce22d None None] MFA Rules not processed for user `f8f1965c186d4af194c85e498edc168f`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:30.881315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-346912c6-3eed-4cd8-a691-af7b1e1ce22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:30.921308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 834/1645] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:30.924348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00716192-aa94-4c46-92cb-56dfefc1085f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:30.928536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-00716192-aa94-4c46-92cb-56dfefc1085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:30.962385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00716192-aa94-4c46-92cb-56dfefc1085f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:30.996379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 812/1646] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:30.997400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346912c6-3eed-4cd8-a691-af7b1e1ce22d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:31.129042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9257a7c-519c-439a-b76f-c8e4247bb6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:31.132166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9257a7c-519c-439a-b76f-c8e4247bb6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.134299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9257a7c-519c-439a-b76f-c8e4247bb6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.134615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9257a7c-519c-439a-b76f-c8e4247bb6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:31.136315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9257a7c-519c-439a-b76f-c8e4247bb6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:31.139748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9257a7c-519c-439a-b76f-c8e4247bb6e8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:31.191439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346912c6-3eed-4cd8-a691-af7b1e1ce22d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:31.197214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778d37c-3e56-4963-a5d7-f02e91497dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:31.198088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d37c-3e56-4963-a5d7-f02e91497dae admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.198545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d37c-3e56-4963-a5d7-f02e91497dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.198917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778d37c-3e56-4963-a5d7-f02e91497dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:31.199708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778d37c-3e56-4963-a5d7-f02e91497dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:31.202056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778d37c-3e56-4963-a5d7-f02e91497dae admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:31.205102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 835/1647] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:30 2022] POST /identity/v3/projects => generated 405 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:31.207401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0b04-41d8-49f3-bf5d-323e752c252b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.207792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0b04-41d8-49f3-bf5d-323e752c252b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.208179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef0b04-41d8-49f3-bf5d-323e752c252b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:31.262102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9eef0b04-41d8-49f3-bf5d-323e752c252b None None] MFA Rules not processed for user `047780e830d14ab8a1cdb9a6061cb939`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:31.263538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9eef0b04-41d8-49f3-bf5d-323e752c252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:31.263841 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 813/1648] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:30 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:31.270299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778d37c-3e56-4963-a5d7-f02e91497dae admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:31.418754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778d37c-3e56-4963-a5d7-f02e91497dae admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:31.420433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 836/1649] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:31.421788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef0b04-41d8-49f3-bf5d-323e752c252b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:31.450480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:31.451635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.456701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef0b04-41d8-49f3-bf5d-323e752c252b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:31.457490 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.458040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:31.458953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:31.466244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:31.478122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be443dd4-3699-4254-8281-f126ee3001ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:31.480168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be443dd4-3699-4254-8281-f126ee3001ed admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.480905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be443dd4-3699-4254-8281-f126ee3001ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.482196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be443dd4-3699-4254-8281-f126ee3001ed admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:31.484349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be443dd4-3699-4254-8281-f126ee3001ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:31.489389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be443dd4-3699-4254-8281-f126ee3001ed admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:31.500494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:31.534097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 814/1650] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:31 2022] POST /identity/v3/users => generated 309 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:31.537459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:31.544343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:31.547199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:31.559621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 837/1651] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:31 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:31.560064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be443dd4-3699-4254-8281-f126ee3001ed admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:31.611286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be443dd4-3699-4254-8281-f126ee3001ed admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:31.624614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739efed-2f67-417a-8f0b-9ce57cef86e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:31.625850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739efed-2f67-417a-8f0b-9ce57cef86e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.626139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739efed-2f67-417a-8f0b-9ce57cef86e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.626417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739efed-2f67-417a-8f0b-9ce57cef86e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:31.628069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739efed-2f67-417a-8f0b-9ce57cef86e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:31.630332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739efed-2f67-417a-8f0b-9ce57cef86e9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:31.660724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 838/1652] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:31.662098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739efed-2f67-417a-8f0b-9ce57cef86e9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:31.688567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739efed-2f67-417a-8f0b-9ce57cef86e9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:31.694534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a408a5-23ad-47ae-878e-497eaae92a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:31.695743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a408a5-23ad-47ae-878e-497eaae92a8d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.696251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a408a5-23ad-47ae-878e-497eaae92a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.697037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a408a5-23ad-47ae-878e-497eaae92a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:31.697912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a408a5-23ad-47ae-878e-497eaae92a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:31.699805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a408a5-23ad-47ae-878e-497eaae92a8d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:31.717374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 839/1653] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:31.718585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a408a5-23ad-47ae-878e-497eaae92a8d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:31.739008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a408a5-23ad-47ae-878e-497eaae92a8d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:31.745464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a340b4-60b6-490f-8d4b-bb3ba1faa148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:31.746444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a340b4-60b6-490f-8d4b-bb3ba1faa148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.746924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a340b4-60b6-490f-8d4b-bb3ba1faa148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.747586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a340b4-60b6-490f-8d4b-bb3ba1faa148 admin admin] PATH_INFO: `/v3/projects/0ec4c365c27a458884e1a1eaf37aaf7b/users/a106634bd5894c7ca1a75239fd863b28/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:31.769857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a340b4-60b6-490f-8d4b-bb3ba1faa148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec4c365c27a458884e1a1eaf37aaf7b, user_id=a106634bd5894c7ca1a75239fd863b28, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:31.776704 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a340b4-60b6-490f-8d4b-bb3ba1faa148 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:31.811363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 840/1654] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:31 2022] PUT /identity/v3/projects/0ec4c365c27a458884e1a1eaf37aaf7b/users/a106634bd5894c7ca1a75239fd863b28/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:31.813798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a340b4-60b6-490f-8d4b-bb3ba1faa148 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:31.894306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70378fa2-726e-45b2-908d-088554072d30 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:31.976552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a340b4-60b6-490f-8d4b-bb3ba1faa148 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:31.993867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d137da3-4367-4a4a-b424-7c8ea4d644f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:31.994851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d137da3-4367-4a4a-b424-7c8ea4d644f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:31.995488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d137da3-4367-4a4a-b424-7c8ea4d644f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:31.995874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d137da3-4367-4a4a-b424-7c8ea4d644f9 admin admin] PATH_INFO: `/v3/projects/edb83fba718c4f2bb381dbd35adf39e5/users/77146b34a0f14448b43d3ee9d947288c/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.043498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d137da3-4367-4a4a-b424-7c8ea4d644f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb83fba718c4f2bb381dbd35adf39e5, user_id=77146b34a0f14448b43d3ee9d947288c, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:32.046943 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d137da3-4367-4a4a-b424-7c8ea4d644f9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:32.076066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 841/1655] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:31 2022] PUT /identity/v3/projects/edb83fba718c4f2bb381dbd35adf39e5/users/77146b34a0f14448b43d3ee9d947288c/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:32.077629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d137da3-4367-4a4a-b424-7c8ea4d644f9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:32.092495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc244-5889-4ef9-9a67-f704276eb5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:32.093490 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc244-5889-4ef9-9a67-f704276eb5d3 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:32.093775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc244-5889-4ef9-9a67-f704276eb5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:32.094095 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc244-5889-4ef9-9a67-f704276eb5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.227489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d137da3-4367-4a4a-b424-7c8ea4d644f9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:32.239825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff3f56-1a10-4608-9bc3-2c405f20c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:32.240556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff3f56-1a10-4608-9bc3-2c405f20c480 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:32.240960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff3f56-1a10-4608-9bc3-2c405f20c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:32.241336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff3f56-1a10-4608-9bc3-2c405f20c480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.242453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc244-5889-4ef9-9a67-f704276eb5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:32.243312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff3f56-1a10-4608-9bc3-2c405f20c480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:32.246703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc244-5889-4ef9-9a67-f704276eb5d3 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:32.255903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff3f56-1a10-4608-9bc3-2c405f20c480 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:32.292077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 815/1656] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:32.298023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc244-5889-4ef9-9a67-f704276eb5d3 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:32.314941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 842/1657] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:32.320499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff3f56-1a10-4608-9bc3-2c405f20c480 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:32.341981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc244-5889-4ef9-9a67-f704276eb5d3 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:32.354844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff3f56-1a10-4608-9bc3-2c405f20c480 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:32.356910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8bed8-a546-4fdb-b932-a2ce5f7db9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:32.362553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8bed8-a546-4fdb-b932-a2ce5f7db9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:32.364613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8bed8-a546-4fdb-b932-a2ce5f7db9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:32.365430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8bed8-a546-4fdb-b932-a2ce5f7db9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.366666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8bed8-a546-4fdb-b932-a2ce5f7db9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:32.368887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8bed8-a546-4fdb-b932-a2ce5f7db9fc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:32.376474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a14d99-765d-4dee-b42c-cf5465259ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:32.377922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14d99-765d-4dee-b42c-cf5465259ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:32.380212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14d99-765d-4dee-b42c-cf5465259ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:32.381459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a14d99-765d-4dee-b42c-cf5465259ed9 admin admin] PATH_INFO: `/v3/projects/0ec4c365c27a458884e1a1eaf37aaf7b/users/a106634bd5894c7ca1a75239fd863b28/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.390537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a14d99-765d-4dee-b42c-cf5465259ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec4c365c27a458884e1a1eaf37aaf7b, user_id=a106634bd5894c7ca1a75239fd863b28, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:32.394448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a14d99-765d-4dee-b42c-cf5465259ed9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:32.404169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 816/1658] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:32.408946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8bed8-a546-4fdb-b932-a2ce5f7db9fc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:32.419699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8bed8-a546-4fdb-b932-a2ce5f7db9fc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:32.433397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:32.434428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:32.434938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:32.435444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] PATH_INFO: `/v3/projects/edb83fba718c4f2bb381dbd35adf39e5/users/77146b34a0f14448b43d3ee9d947288c/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.442713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edb83fba718c4f2bb381dbd35adf39e5, user_id=77146b34a0f14448b43d3ee9d947288c, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:32.444124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 843/1659] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:32 2022] PUT /identity/v3/projects/0ec4c365c27a458884e1a1eaf37aaf7b/users/a106634bd5894c7ca1a75239fd863b28/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:32.456600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:32.491191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 817/1660] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:32 2022] PUT /identity/v3/projects/edb83fba718c4f2bb381dbd35adf39e5/users/77146b34a0f14448b43d3ee9d947288c/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:32.491428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376266f-e65e-49fa-bf0d-2b18cdc0bbb7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:32.491722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376266f-e65e-49fa-bf0d-2b18cdc0bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:32.491998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376266f-e65e-49fa-bf0d-2b18cdc0bbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.572706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1376266f-e65e-49fa-bf0d-2b18cdc0bbb7 None None] MFA Rules not processed for user `77146b34a0f14448b43d3ee9d947288c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:32.573967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1376266f-e65e-49fa-bf0d-2b18cdc0bbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:32.583241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:32.773989 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:32.775897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:32.779553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 844/1661] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:32.787351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:32.792120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376266f-e65e-49fa-bf0d-2b18cdc0bbb7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:32.793574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1376266f-e65e-49fa-bf0d-2b18cdc0bbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:32.930248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376266f-e65e-49fa-bf0d-2b18cdc0bbb7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:32.940237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b738-000b-406c-81b8-24f0134a25a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:32.941108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b738-000b-406c-81b8-24f0134a25a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:32.941265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96d291-db85-479e-bcfc-165ec1b6b1b7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:32.944214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b738-000b-406c-81b8-24f0134a25a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:32.944876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b738-000b-406c-81b8-24f0134a25a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.957894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:32.958702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:32.959018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:32.959298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] PATH_INFO: `/v3/projects/ab7de5a941044b50bd04bfce3ecd8b8c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:32.977198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7de5a941044b50bd04bfce3ecd8b8c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:32.979763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: WARNING py.warnings [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:18:32.979763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: warnings.warn(msg) Sep 16 19:18:32.979763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: Sep 16 19:18:32.990225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:33.147332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299b738-000b-406c-81b8-24f0134a25a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:33.150737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299b738-000b-406c-81b8-24f0134a25a9 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:33.180057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7de5a941044b50bd04bfce3ecd8b8c', 'request_id': 'req-748caf7e-f322-46b8-99e2-6149fd83b4a6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:33.204287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 845/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:18:33.227044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7de5a941044b50bd04bfce3ecd8b8c', 'request_id': 'req-748caf7e-f322-46b8-99e2-6149fd83b4a6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:33.247595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7de5a941044b50bd04bfce3ecd8b8c', 'request_id': 'req-748caf7e-f322-46b8-99e2-6149fd83b4a6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:33.287866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] The token cache is being invalidate because project ab7de5a941044b50bd04bfce3ecd8b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:33.288189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:33.289718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-748caf7e-f322-46b8-99e2-6149fd83b4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:33.292810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 818/1663] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:32 2022] DELETE /identity/v3/projects/ab7de5a941044b50bd04bfce3ecd8b8c => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:18:33.297748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a6d0-db6a-4c50-937b-abbe2d5ef5a9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:33.298216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a6d0-db6a-4c50-937b-abbe2d5ef5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:33.298637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137a6d0-db6a-4c50-937b-abbe2d5ef5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:33.368984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2137a6d0-db6a-4c50-937b-abbe2d5ef5a9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:33.380167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2137a6d0-db6a-4c50-937b-abbe2d5ef5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:33.630263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:33.666340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 846/1664] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:33.674807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8e29-398f-45fa-8d47-11ebfd0971c3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:33.675432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8e29-398f-45fa-8d47-11ebfd0971c3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:33.675432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8e29-398f-45fa-8d47-11ebfd0971c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:33.720324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-80ab8e29-398f-45fa-8d47-11ebfd0971c3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:33.721619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-80ab8e29-398f-45fa-8d47-11ebfd0971c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:33.747498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 819/1665] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:33.748834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137a6d0-db6a-4c50-937b-abbe2d5ef5a9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:33.764919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137a6d0-db6a-4c50-937b-abbe2d5ef5a9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:33.791824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:33.793566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:33.796943 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:33.797885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:33.803955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:33.806493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:33.816085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:33.885496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 847/1666] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:33.888631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8e29-398f-45fa-8d47-11ebfd0971c3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:33.903902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8e29-398f-45fa-8d47-11ebfd0971c3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:33.926585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af46a0-512c-4229-bd33-cc1b680438bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:33.927314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af46a0-512c-4229-bd33-cc1b680438bd admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:33.927517 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af46a0-512c-4229-bd33-cc1b680438bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:33.927798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af46a0-512c-4229-bd33-cc1b680438bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:33.928459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af46a0-512c-4229-bd33-cc1b680438bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:33.930835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af46a0-512c-4229-bd33-cc1b680438bd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:34.020402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 820/1667] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:33 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:34.036325 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:34.059487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6266aa7-cf67-4ebc-8021-c4dc670316d3 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:34.226083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8666f-5fde-4c20-8563-fbfb4e1fc855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:34.227055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8666f-5fde-4c20-8563-fbfb4e1fc855 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:34.227439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8666f-5fde-4c20-8563-fbfb4e1fc855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:34.227817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8666f-5fde-4c20-8563-fbfb4e1fc855 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:34.228930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8666f-5fde-4c20-8563-fbfb4e1fc855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:34.232736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8666f-5fde-4c20-8563-fbfb4e1fc855 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:34.266760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 848/1668] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:34 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:34.272164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af46a0-512c-4229-bd33-cc1b680438bd admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:34.300951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af46a0-512c-4229-bd33-cc1b680438bd admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:34.308604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb48123-9f89-48cc-bda0-023ccdd2f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:34.310414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48123-9f89-48cc-bda0-023ccdd2f256 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:34.311786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48123-9f89-48cc-bda0-023ccdd2f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:34.312434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb48123-9f89-48cc-bda0-023ccdd2f256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:34.313743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb48123-9f89-48cc-bda0-023ccdd2f256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:34.316263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb48123-9f89-48cc-bda0-023ccdd2f256 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:34.333164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 821/1669] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:34.336846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8666f-5fde-4c20-8563-fbfb4e1fc855 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:34.403637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8666f-5fde-4c20-8563-fbfb4e1fc855 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:34.423428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088021c7-f282-4e1a-97ba-7112c0931001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:34.427980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088021c7-f282-4e1a-97ba-7112c0931001 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:34.428470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088021c7-f282-4e1a-97ba-7112c0931001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:34.429572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088021c7-f282-4e1a-97ba-7112c0931001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:34.430633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088021c7-f282-4e1a-97ba-7112c0931001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:34.434234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088021c7-f282-4e1a-97ba-7112c0931001 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:34.491093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 849/1670] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:34.495481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb48123-9f89-48cc-bda0-023ccdd2f256 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:34.513576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb48123-9f89-48cc-bda0-023ccdd2f256 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:34.530586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7cea-9a37-4ac9-a60b-e33049a117f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:34.531391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7cea-9a37-4ac9-a60b-e33049a117f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:34.531681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7cea-9a37-4ac9-a60b-e33049a117f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:34.531957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7cea-9a37-4ac9-a60b-e33049a117f7 admin admin] PATH_INFO: `/v3/projects/8d87e689842a43d79caa58de49493553/users/7d48498c9fb74005a406cad5aebf91c8/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:34.585584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7cea-9a37-4ac9-a60b-e33049a117f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d87e689842a43d79caa58de49493553, user_id=7d48498c9fb74005a406cad5aebf91c8, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:34.588718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7cea-9a37-4ac9-a60b-e33049a117f7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:34.622146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 822/1671] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:34 2022] PUT /identity/v3/projects/8d87e689842a43d79caa58de49493553/users/7d48498c9fb74005a406cad5aebf91c8/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:34.634485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e678-4475-457b-8165-d2a61034cd0b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:34.635042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e678-4475-457b-8165-d2a61034cd0b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:34.635313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95e678-4475-457b-8165-d2a61034cd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:34.710767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9e95e678-4475-457b-8165-d2a61034cd0b None None] MFA Rules not processed for user `7d48498c9fb74005a406cad5aebf91c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:34.724414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9e95e678-4475-457b-8165-d2a61034cd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:34.916829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 850/1672] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:34.921032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7cea-9a37-4ac9-a60b-e33049a117f7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:34.992384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:35.038646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7cea-9a37-4ac9-a60b-e33049a117f7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:35.044162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca37fc-d66e-4ac8-83db-08a729e795bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:35.044656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca37fc-d66e-4ac8-83db-08a729e795bd admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:35.045112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca37fc-d66e-4ac8-83db-08a729e795bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:35.045515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca37fc-d66e-4ac8-83db-08a729e795bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:35.046046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca37fc-d66e-4ac8-83db-08a729e795bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:35.048043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca37fc-d66e-4ac8-83db-08a729e795bd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:35.087446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 823/1673] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:34 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:35.091433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95e678-4475-457b-8165-d2a61034cd0b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:35.109582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95e678-4475-457b-8165-d2a61034cd0b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:35.224824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aabaa-cc40-477a-9fe7-28953744849e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:35.224824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aabaa-cc40-477a-9fe7-28953744849e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:35.225019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12aabaa-cc40-477a-9fe7-28953744849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:35.242087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:35.256456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:35.257975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:35.259348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:35.259845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:35.260858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:35.263309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:35.304948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b12aabaa-cc40-477a-9fe7-28953744849e None None] MFA Rules not processed for user `a106634bd5894c7ca1a75239fd863b28`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:35.306412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b12aabaa-cc40-477a-9fe7-28953744849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:35.339052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 851/1674] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:35 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:35.343370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:35.345308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:35.467023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b0b63-6374-4125-9406-1d2986124cdf admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:35.478469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:35.479461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:35.479920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:35.480393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:35.484167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:35.493589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 824/1675] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:35 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:35.493589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12aabaa-cc40-477a-9fe7-28953744849e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:35.504255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12aabaa-cc40-477a-9fe7-28953744849e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:35.509582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f70f7-f334-4a26-b383-8270961de3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:35.510400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f70f7-f334-4a26-b383-8270961de3bd admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:35.510679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f70f7-f334-4a26-b383-8270961de3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:35.510953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f70f7-f334-4a26-b383-8270961de3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:35.511763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f70f7-f334-4a26-b383-8270961de3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:35.514307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f70f7-f334-4a26-b383-8270961de3bd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:35.539860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 825/1676] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:35.548384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f70f7-f334-4a26-b383-8270961de3bd admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:35.561721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f70f7-f334-4a26-b383-8270961de3bd admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:35.574015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c038-c33e-4666-9c61-44494395d184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:35.576680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c038-c33e-4666-9c61-44494395d184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:35.577364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c038-c33e-4666-9c61-44494395d184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:35.579255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c038-c33e-4666-9c61-44494395d184 admin admin] PATH_INFO: `/v3/projects/31aa08a513254b33850c8848a43a83e9/users/2b29a1905a29431893a371b373b14f4f/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:35.598135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:35.600255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:35.618454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 852/1677] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:35.639913 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305c038-c33e-4666-9c61-44494395d184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31aa08a513254b33850c8848a43a83e9, user_id=2b29a1905a29431893a371b373b14f4f, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:35.642703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305c038-c33e-4666-9c61-44494395d184 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:35.668368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 826/1678] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:35 2022] PUT /identity/v3/projects/31aa08a513254b33850c8848a43a83e9/users/2b29a1905a29431893a371b373b14f4f/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:35.672218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:35.691483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faddd1a-9aa3-4b87-b1f3-1af7ef912be6 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:35.909341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd8d56-ef54-49cf-9a94-cb0a7937af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:35.910137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8d56-ef54-49cf-9a94-cb0a7937af52 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:35.910243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8d56-ef54-49cf-9a94-cb0a7937af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:35.910523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd8d56-ef54-49cf-9a94-cb0a7937af52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:35.911261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd8d56-ef54-49cf-9a94-cb0a7937af52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:35.912891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd8d56-ef54-49cf-9a94-cb0a7937af52 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:35.952205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 853/1679] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:35.953601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c038-c33e-4666-9c61-44494395d184 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:35.969626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c038-c33e-4666-9c61-44494395d184 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:35.984662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30014ad6-64df-498e-b677-7624513cfddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:35.985784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30014ad6-64df-498e-b677-7624513cfddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:35.986436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30014ad6-64df-498e-b677-7624513cfddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:35.986826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30014ad6-64df-498e-b677-7624513cfddd admin admin] PATH_INFO: `/v3/projects/31aa08a513254b33850c8848a43a83e9/users/2b29a1905a29431893a371b373b14f4f/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:35.993023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30014ad6-64df-498e-b677-7624513cfddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=31aa08a513254b33850c8848a43a83e9, user_id=2b29a1905a29431893a371b373b14f4f, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:36.005042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30014ad6-64df-498e-b677-7624513cfddd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:36.044383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 827/1680] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:35 2022] PUT /identity/v3/projects/31aa08a513254b33850c8848a43a83e9/users/2b29a1905a29431893a371b373b14f4f/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:36.057357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf8cd-8f56-4d75-9e6b-9abe0838fe33 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:36.057633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf8cd-8f56-4d75-9e6b-9abe0838fe33 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:36.057940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18cf8cd-8f56-4d75-9e6b-9abe0838fe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:36.158381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b18cf8cd-8f56-4d75-9e6b-9abe0838fe33 None None] MFA Rules not processed for user `2b29a1905a29431893a371b373b14f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:36.163520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b18cf8cd-8f56-4d75-9e6b-9abe0838fe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:36.219491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:36.327861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 854/1681] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:36.336755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30014ad6-64df-498e-b677-7624513cfddd admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:36.473002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30014ad6-64df-498e-b677-7624513cfddd admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:36.478700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dce129-dabd-41a7-aede-0fdcf88c6810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:36.479682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce129-dabd-41a7-aede-0fdcf88c6810 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:36.480197 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce129-dabd-41a7-aede-0fdcf88c6810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:36.480688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dce129-dabd-41a7-aede-0fdcf88c6810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:36.490329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:36.495150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dce129-dabd-41a7-aede-0fdcf88c6810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:36.497190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dce129-dabd-41a7-aede-0fdcf88c6810 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:36.520786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 828/1682] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:36.696774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cf8cd-8f56-4d75-9e6b-9abe0838fe33 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:36.710152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18cf8cd-8f56-4d75-9e6b-9abe0838fe33 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:36.724649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00767657-6dc3-46c7-80fe-54877b36acee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:36.725391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00767657-6dc3-46c7-80fe-54877b36acee service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:36.725674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00767657-6dc3-46c7-80fe-54877b36acee service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:36.725952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00767657-6dc3-46c7-80fe-54877b36acee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:36.851559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00767657-6dc3-46c7-80fe-54877b36acee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:36.853030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00767657-6dc3-46c7-80fe-54877b36acee service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:36.866774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 855/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:36.941167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f6bd-0fb3-4230-b17c-133a1a394099 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:36.941493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f6bd-0fb3-4230-b17c-133a1a394099 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:36.941732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252f6bd-0fb3-4230-b17c-133a1a394099 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:36.943444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 829/1684] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:36.979193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1900c3-c56c-42ae-bc4e-e6db332a1152 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:36.979481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1900c3-c56c-42ae-bc4e-e6db332a1152 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:36.979748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1900c3-c56c-42ae-bc4e-e6db332a1152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:37.027721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2f1900c3-c56c-42ae-bc4e-e6db332a1152 None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:37.030886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2f1900c3-c56c-42ae-bc4e-e6db332a1152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:37.196537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 856/1685] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:37.246169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f6bd-0fb3-4230-b17c-133a1a394099 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:37.249891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e252f6bd-0fb3-4230-b17c-133a1a394099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:37.284125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252f6bd-0fb3-4230-b17c-133a1a394099 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:37.299118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86287e-c762-436b-914b-8f0889fd8860 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:37.300168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86287e-c762-436b-914b-8f0889fd8860 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:37.300548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86287e-c762-436b-914b-8f0889fd8860 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:37.300929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86287e-c762-436b-914b-8f0889fd8860 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:37.321800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86287e-c762-436b-914b-8f0889fd8860 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:37.325649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86287e-c762-436b-914b-8f0889fd8860 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:37.350472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 830/1686] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:38.564057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1900c3-c56c-42ae-bc4e-e6db332a1152 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:38.566553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2f1900c3-c56c-42ae-bc4e-e6db332a1152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:38.643822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:38.682352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1900c3-c56c-42ae-bc4e-e6db332a1152 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:38.697549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:38.697549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:38.697839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:38.698245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] PATH_INFO: `/v3/users/383da3d0374e4b6b9e44aad1c58bc213` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:38.699544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383da3d0374e4b6b9e44aad1c58bc213)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:38.700638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: WARNING py.warnings [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 19:18:38.700638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: warnings.warn(msg) Sep 16 19:18:38.700638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: Sep 16 19:18:38.701864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:38.844547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383da3d0374e4b6b9e44aad1c58bc213'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:38.859365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383da3d0374e4b6b9e44aad1c58bc213'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:38.860752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383da3d0374e4b6b9e44aad1c58bc213'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:38.862205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383da3d0374e4b6b9e44aad1c58bc213'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:38.891903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a558-17a3-4850-85c8-595ba4208ae0 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:38.893011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a558-17a3-4850-85c8-595ba4208ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:38.893505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8a558-17a3-4850-85c8-595ba4208ae0 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:38.895407 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 831/1687] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:18:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:18:38.927532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-86805401-ae87-4238-95ce-98e1fb1b6049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383da3d0374e4b6b9e44aad1c58bc213'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:38.950724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 857/1688] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:38 2022] DELETE /identity/v3/users/383da3d0374e4b6b9e44aad1c58bc213 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:38.955683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6824d-1bde-4fd9-b3b7-d9e232baebf1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:38.955972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6824d-1bde-4fd9-b3b7-d9e232baebf1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:38.956255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6824d-1bde-4fd9-b3b7-d9e232baebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:38.992213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2fa6824d-1bde-4fd9-b3b7-d9e232baebf1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:38.993477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2fa6824d-1bde-4fd9-b3b7-d9e232baebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:39.101093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f814-3fdf-4548-a22c-d788158c37ad None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:39.101743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f814-3fdf-4548-a22c-d788158c37ad None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:39.102289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541f814-3fdf-4548-a22c-d788158c37ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:39.134854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 832/1689] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:39.153695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3541f814-3fdf-4548-a22c-d788158c37ad None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:39.155144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3541f814-3fdf-4548-a22c-d788158c37ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:39.164837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6824d-1bde-4fd9-b3b7-d9e232baebf1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:39.166882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2fa6824d-1bde-4fd9-b3b7-d9e232baebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:39.275111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6824d-1bde-4fd9-b3b7-d9e232baebf1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:39.278929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:39.279656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:39.279939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:39.280261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:39.294179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:39.295865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:39.309134 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 833/1690] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:39.396198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 858/1691] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:39.492953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:39.494689 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:39.519501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7b7f-ac1d-4a4b-a1b7-c678042fbec6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:39.519803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7b7f-ac1d-4a4b-a1b7-c678042fbec6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:39.520063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b7b7f-ac1d-4a4b-a1b7-c678042fbec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:39.525445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd709-2953-48e4-998a-5f378d0cc6fa service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:39.540084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:39.541483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:39.541970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:39.542629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:39.556319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:39.558625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:39.580439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 834/1692] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:39.596499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2d7b7b7f-ac1d-4a4b-a1b7-c678042fbec6 None None] MFA Rules not processed for user `9a80fb7510eb4034bcbf610adb63e1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:39.598576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2d7b7b7f-ac1d-4a4b-a1b7-c678042fbec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:39.616083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:39.618114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:39.646911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db70b3-ffc2-4795-82a9-4cd80bbc0886 service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:39.657058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:39.664568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:39.665018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:39.665464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] PATH_INFO: `/v3/users/3b30e32aa9ed462a95d348a607849d71` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:39.669408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b30e32aa9ed462a95d348a607849d71)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:39.677510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:39.746715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:39.783099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 859/1693] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:39.786054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c21fb-b611-4ffc-ab10-c12e6e92a85c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:39.786343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c21fb-b611-4ffc-ab10-c12e6e92a85c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:39.786627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c21fb-b611-4ffc-ab10-c12e6e92a85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:39.822710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b30e32aa9ed462a95d348a607849d71'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:39.827523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9c9c21fb-b611-4ffc-ab10-c12e6e92a85c None None] MFA Rules not processed for user `9a80fb7510eb4034bcbf610adb63e1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:39.828777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9c9c21fb-b611-4ffc-ab10-c12e6e92a85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:39.840784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b30e32aa9ed462a95d348a607849d71'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:39.842324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b30e32aa9ed462a95d348a607849d71'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:39.843174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b30e32aa9ed462a95d348a607849d71'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:39.856772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 860/1694] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:39.872187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c21fb-b611-4ffc-ab10-c12e6e92a85c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:39.873088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b30e32aa9ed462a95d348a607849d71'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:39.873809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9c9c21fb-b611-4ffc-ab10-c12e6e92a85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:39.881334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:39.925657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 835/1695] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:39 2022] DELETE /identity/v3/users/3b30e32aa9ed462a95d348a607849d71 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:40.152433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c21fb-b611-4ffc-ab10-c12e6e92a85c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:40.404066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:40.406003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:40.423331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:40.424878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:40.425165 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:40.425466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:40.432832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:40.594049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:40.595881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:40.605586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b441f9f-6024-4ccd-98fb-7302ad923c3c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:40.619605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:40.620197 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:40.623448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:40.623939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] PATH_INFO: `/v3/users/7d48498c9fb74005a406cad5aebf91c8` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:40.626588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d48498c9fb74005a406cad5aebf91c8)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:40.637462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:40.650864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 861/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:18:40.652522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:40.653465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:40.696457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655bdbc8-fc8a-4ee2-b17b-c6fec5bb46cc service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:40.705698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:40.706359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:40.706627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:40.706904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] PATH_INFO: `/v3/users/f8f1965c186d4af194c85e498edc168f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:40.710747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f1965c186d4af194c85e498edc168f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:40.715356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:40.748050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:40.759694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d48498c9fb74005a406cad5aebf91c8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.771907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d48498c9fb74005a406cad5aebf91c8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.772953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d48498c9fb74005a406cad5aebf91c8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.773819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d48498c9fb74005a406cad5aebf91c8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.815150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-753b8055-4a59-40b3-a7ff-9ad32fd99d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d48498c9fb74005a406cad5aebf91c8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.862868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 836/1697] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:40 2022] DELETE /identity/v3/users/7d48498c9fb74005a406cad5aebf91c8 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:40.866146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f1965c186d4af194c85e498edc168f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.870140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804682b-6e7f-4bf1-a739-b321eafc3781 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:40.870437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804682b-6e7f-4bf1-a739-b321eafc3781 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:40.870719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804682b-6e7f-4bf1-a739-b321eafc3781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:40.883955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f1965c186d4af194c85e498edc168f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.885602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f1965c186d4af194c85e498edc168f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.886678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f1965c186d4af194c85e498edc168f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.902301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1804682b-6e7f-4bf1-a739-b321eafc3781 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:40.904235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1804682b-6e7f-4bf1-a739-b321eafc3781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:40.916606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f1965c186d4af194c85e498edc168f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:40.951900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 862/1698] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:40 2022] DELETE /identity/v3/users/f8f1965c186d4af194c85e498edc168f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:40.957468 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:40.959633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.049808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 837/1699] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:41.051210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5ba4-49ce-46c6-a510-16bf7642e271 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.051506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5ba4-49ce-46c6-a510-16bf7642e271 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.053754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f5ba4-49ce-46c6-a510-16bf7642e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:41.067489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:41.146636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-070f5ba4-49ce-46c6-a510-16bf7642e271 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:41.150126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-070f5ba4-49ce-46c6-a510-16bf7642e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.175366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 838/1700] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:41.180451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b44b90-7914-484a-87d3-7acda4fa96fb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:41.182043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5ba4-49ce-46c6-a510-16bf7642e271 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:41.185464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-070f5ba4-49ce-46c6-a510-16bf7642e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.190826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:41.191664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.192800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.193531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] PATH_INFO: `/v3/projects/71f4028a90274463b03bae2927d07e33` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:41.201125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f4028a90274463b03bae2927d07e33)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:41.203249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:41.375100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f4028a90274463b03bae2927d07e33', 'request_id': 'req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:41.391214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f4028a90274463b03bae2927d07e33', 'request_id': 'req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:41.396245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f5ba4-49ce-46c6-a510-16bf7642e271 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:41.420008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f4028a90274463b03bae2927d07e33', 'request_id': 'req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:41.477562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] The token cache is being invalidate because project 71f4028a90274463b03bae2927d07e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:41.477865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:41.479349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:41.482530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 863/1701] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:40 2022] DELETE /identity/v3/projects/71f4028a90274463b03bae2927d07e33 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:41.483435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:41.488109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.585078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2e87-b7d2-44fe-84e7-b25358b5ede2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:41.586837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2e87-b7d2-44fe-84e7-b25358b5ede2 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.587320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2e87-b7d2-44fe-84e7-b25358b5ede2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.587676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2e87-b7d2-44fe-84e7-b25358b5ede2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:41.589218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:41.590353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b68c2e87-b7d2-44fe-84e7-b25358b5ede2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.686014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310378-bed4-4a8d-83c3-9fdb3d4f5427 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:41.699887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248bb7a-db74-4614-8e96-85ff372d0bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:41.699887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bb7a-db74-4614-8e96-85ff372d0bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.699887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bb7a-db74-4614-8e96-85ff372d0bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.700260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248bb7a-db74-4614-8e96-85ff372d0bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:41.703887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9248bb7a-db74-4614-8e96-85ff372d0bf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.828168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c2e87-b7d2-44fe-84e7-b25358b5ede2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:41.829902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c2e87-b7d2-44fe-84e7-b25358b5ede2 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:41.884243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 839/1702] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:41.886087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed634e6f-bcfe-4b72-9976-67d1b4e88873 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.886675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed634e6f-bcfe-4b72-9976-67d1b4e88873 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.887431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed634e6f-bcfe-4b72-9976-67d1b4e88873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:41.912832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248bb7a-db74-4614-8e96-85ff372d0bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:41.917553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248bb7a-db74-4614-8e96-85ff372d0bf0 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:41.942541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ed634e6f-bcfe-4b72-9976-67d1b4e88873 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:41.943738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 864/1703] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:41.947467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ed634e6f-bcfe-4b72-9976-67d1b4e88873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:41.950620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833778f-4dc8-4e50-9a7e-3a4146ab627d None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.951340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833778f-4dc8-4e50-9a7e-3a4146ab627d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.951636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833778f-4dc8-4e50-9a7e-3a4146ab627d None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:41.953043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 865/1704] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 16 19:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:41.963722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cb04e-9e73-4453-a8b8-a0fa4dc81186 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.964547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cb04e-9e73-4453-a8b8-a0fa4dc81186 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.964970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cb04e-9e73-4453-a8b8-a0fa4dc81186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:41.975114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 840/1705] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:41.977644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717361d2-2905-43e8-834b-204279b1b03e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:41.978115 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717361d2-2905-43e8-834b-204279b1b03e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:41.978851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717361d2-2905-43e8-834b-204279b1b03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.032303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-717361d2-2905-43e8-834b-204279b1b03e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:42.034768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-717361d2-2905-43e8-834b-204279b1b03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:42.070238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 841/1706] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:42.070238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dd693-d0cb-423c-b7dd-a93de2ee32d3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:42.070238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dd693-d0cb-423c-b7dd-a93de2ee32d3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:42.070238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dd693-d0cb-423c-b7dd-a93de2ee32d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.090791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cb4cb04e-9e73-4453-a8b8-a0fa4dc81186 None None] MFA Rules not processed for user `1c0ab0eca7de4bed89b5f292a52f8c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:42.092122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cb4cb04e-9e73-4453-a8b8-a0fa4dc81186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:42.108812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 866/1707] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:18:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:42.116647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cb04e-9e73-4453-a8b8-a0fa4dc81186 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:42.133982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-de9dd693-d0cb-423c-b7dd-a93de2ee32d3 None None] MFA Rules not processed for user `047780e830d14ab8a1cdb9a6061cb939`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:42.134586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cb04e-9e73-4453-a8b8-a0fa4dc81186 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:42.135598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-de9dd693-d0cb-423c-b7dd-a93de2ee32d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:42.147146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:42.152376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:42.153575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:42.153875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.154574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:42.154892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:42.156619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:42.182102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 867/1708] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:42.183410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:42.191103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:42.223643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270415e-c1c3-42ff-a1b0-1d7076b8740a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:42.229788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:42.230456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:42.230742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:42.231089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] PATH_INFO: `/v3/projects/9f54bcb066ad42e0bdcbd24322249bb5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.232319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f54bcb066ad42e0bdcbd24322249bb5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:42.234274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:42.252869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:42.291626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 842/1709] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:42.293031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dd693-d0cb-423c-b7dd-a93de2ee32d3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:42.300175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-de9dd693-d0cb-423c-b7dd-a93de2ee32d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:42.349655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dd693-d0cb-423c-b7dd-a93de2ee32d3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:42.360832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f54bcb066ad42e0bdcbd24322249bb5', 'request_id': 'req-98cfb322-e405-4c1d-80f3-09b1ce53666d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:42.376433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f54bcb066ad42e0bdcbd24322249bb5', 'request_id': 'req-98cfb322-e405-4c1d-80f3-09b1ce53666d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:42.396266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f54bcb066ad42e0bdcbd24322249bb5', 'request_id': 'req-98cfb322-e405-4c1d-80f3-09b1ce53666d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:42.421222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] The token cache is being invalidate because project 9f54bcb066ad42e0bdcbd24322249bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:42.421434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:42.431693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:42.433467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 868/1710] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:42 2022] DELETE /identity/v3/projects/9f54bcb066ad42e0bdcbd24322249bb5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:42.437737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:42.447518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:42.529480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:42.530716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:42.531313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:42.533967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.539449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:42.551508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:42.582925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:42.584701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:42.621698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 843/1711] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:42.625663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:42.633764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:42.676079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfb322-e405-4c1d-80f3-09b1ce53666d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:42.688110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297d7e-ec48-4b7d-a8ea-4778ffb9a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:42.689803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297d7e-ec48-4b7d-a8ea-4778ffb9a1cb admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:42.689803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297d7e-ec48-4b7d-a8ea-4778ffb9a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:42.690234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d297d7e-ec48-4b7d-a8ea-4778ffb9a1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.691420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d297d7e-ec48-4b7d-a8ea-4778ffb9a1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:42.693420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d297d7e-ec48-4b7d-a8ea-4778ffb9a1cb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:42.734460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 869/1712] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:42 2022] POST /identity/v3/projects => generated 363 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:42.739742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297d7e-ec48-4b7d-a8ea-4778ffb9a1cb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:42.821911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d297d7e-ec48-4b7d-a8ea-4778ffb9a1cb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:42.832458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70621b56-376b-4aba-a169-bd5974b3f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:42.833552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621b56-376b-4aba-a169-bd5974b3f4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:42.834093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621b56-376b-4aba-a169-bd5974b3f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:42.834568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621b56-376b-4aba-a169-bd5974b3f4e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.836301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70621b56-376b-4aba-a169-bd5974b3f4e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:42.848889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70621b56-376b-4aba-a169-bd5974b3f4e4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:42.852627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ebd1a-bb31-491b-9b86-00fdd902fb51 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:42.862747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:42.863022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:42.863285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:42.863472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] PATH_INFO: `/v3/users/a106634bd5894c7ca1a75239fd863b28` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.864696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a106634bd5894c7ca1a75239fd863b28)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:42.866629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:42.914525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 870/1713] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:42 2022] POST /identity/v3/users => generated 282 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:42.916484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70621b56-376b-4aba-a169-bd5974b3f4e4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:42.941582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70621b56-376b-4aba-a169-bd5974b3f4e4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:42.953452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646e81-aa13-48e2-9eb4-7d1e9a3da7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:42.953995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646e81-aa13-48e2-9eb4-7d1e9a3da7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:42.954286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646e81-aa13-48e2-9eb4-7d1e9a3da7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:42.955769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed646e81-aa13-48e2-9eb4-7d1e9a3da7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:42.956316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed646e81-aa13-48e2-9eb4-7d1e9a3da7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:42.962520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed646e81-aa13-48e2-9eb4-7d1e9a3da7ac admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:42.983990 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 871/1714] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:42.992320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646e81-aa13-48e2-9eb4-7d1e9a3da7ac admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:42.998605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a106634bd5894c7ca1a75239fd863b28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:43.010813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed646e81-aa13-48e2-9eb4-7d1e9a3da7ac admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:43.013958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a106634bd5894c7ca1a75239fd863b28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:43.014598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a106634bd5894c7ca1a75239fd863b28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:43.015293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a106634bd5894c7ca1a75239fd863b28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:43.039805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d8903d8f-c081-47af-bc24-0e5592fe3b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a106634bd5894c7ca1a75239fd863b28'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:43.046829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:43.047492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:43.047773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:43.048046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:43.048938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:43.050865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:43.072352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 872/1715] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:43.073253 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:43.075809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:43.089984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c6618-035b-41ab-becb-6a8c4265b8bf admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:43.095141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa7d1e-0ca1-4909-964a-30343f5e6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:43.096156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa7d1e-0ca1-4909-964a-30343f5e6d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:43.096452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa7d1e-0ca1-4909-964a-30343f5e6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:43.096734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa7d1e-0ca1-4909-964a-30343f5e6d5d admin admin] PATH_INFO: `/v3/projects/0944823195bd44ce80d3f70d39209fb5/users/235d99909a204a228a2b9121fe7abc03/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:43.105991 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 844/1716] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:42 2022] DELETE /identity/v3/users/a106634bd5894c7ca1a75239fd863b28 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:43.121260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa7d1e-0ca1-4909-964a-30343f5e6d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0944823195bd44ce80d3f70d39209fb5, user_id=235d99909a204a228a2b9121fe7abc03, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:43.124587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa7d1e-0ca1-4909-964a-30343f5e6d5d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:43.159636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 873/1717] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:43 2022] PUT /identity/v3/projects/0944823195bd44ce80d3f70d39209fb5/users/235d99909a204a228a2b9121fe7abc03/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:43.160709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0989a9-6946-4e0e-aec3-95e4a8ac6768 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:43.160995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0989a9-6946-4e0e-aec3-95e4a8ac6768 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:43.161272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0989a9-6946-4e0e-aec3-95e4a8ac6768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:43.227970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5b0989a9-6946-4e0e-aec3-95e4a8ac6768 None None] MFA Rules not processed for user `235d99909a204a228a2b9121fe7abc03`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:43.229483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5b0989a9-6946-4e0e-aec3-95e4a8ac6768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:43.237198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:43.374366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00bc48-a7e9-4942-bbeb-70446a027452 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:43.375154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00bc48-a7e9-4942-bbeb-70446a027452 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:43.375853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00bc48-a7e9-4942-bbeb-70446a027452 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:43.378057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 845/1718] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:43.379640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 874/1719] 10.222.0.20 () {54 vars in 912 bytes} [Fri Sep 16 19:18:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:18:43.383401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0989a9-6946-4e0e-aec3-95e4a8ac6768 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:43.387302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fde35-cf54-406a-8700-a9a433b0ba00 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:43.387869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fde35-cf54-406a-8700-a9a433b0ba00 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:43.389431 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fde35-cf54-406a-8700-a9a433b0ba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:43.486789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-761fde35-cf54-406a-8700-a9a433b0ba00 None None] MFA Rules not processed for user `1c0ab0eca7de4bed89b5f292a52f8c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:43.487769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-761fde35-cf54-406a-8700-a9a433b0ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:43.582577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0989a9-6946-4e0e-aec3-95e4a8ac6768 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:43.631538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029ecee-5b43-4c00-a7fe-9dcbd487b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:43.634396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ecee-5b43-4c00-a7fe-9dcbd487b45d admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:43.634677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ecee-5b43-4c00-a7fe-9dcbd487b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:43.634957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029ecee-5b43-4c00-a7fe-9dcbd487b45d admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:43.638344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ecee-5b43-4c00-a7fe-9dcbd487b45d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:43.639129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 875/1720] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:43.651915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029ecee-5b43-4c00-a7fe-9dcbd487b45d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:43.724912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fde35-cf54-406a-8700-a9a433b0ba00 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:43.726828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-761fde35-cf54-406a-8700-a9a433b0ba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:43.733573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:43.744364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fde35-cf54-406a-8700-a9a433b0ba00 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:43.770896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 846/1721] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:43 2022] POST /identity/v3/projects => generated 365 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:43.774184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:43.774813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029ecee-5b43-4c00-a7fe-9dcbd487b45d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:43.779158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:43.779535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:43.779769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:43.809799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:43.815367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:43.840276 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 876/1722] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:43.863898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:43.866423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:43.919459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029ecee-5b43-4c00-a7fe-9dcbd487b45d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:43.936417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d808207-a076-4be4-b902-4f36c1147ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:43.937074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808207-a076-4be4-b902-4f36c1147ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:43.937360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808207-a076-4be4-b902-4f36c1147ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:43.937644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d808207-a076-4be4-b902-4f36c1147ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:43.938298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d808207-a076-4be4-b902-4f36c1147ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:43.941081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d808207-a076-4be4-b902-4f36c1147ff6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:43.982668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 847/1723] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:43 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:43.986878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d808207-a076-4be4-b902-4f36c1147ff6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:44.011527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d808207-a076-4be4-b902-4f36c1147ff6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:44.023563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba62e3-3ac5-4e86-9f17-a3ae7f9151f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:44.024727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba62e3-3ac5-4e86-9f17-a3ae7f9151f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.026138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba62e3-3ac5-4e86-9f17-a3ae7f9151f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.026520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba62e3-3ac5-4e86-9f17-a3ae7f9151f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.027564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba62e3-3ac5-4e86-9f17-a3ae7f9151f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:44.029474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba62e3-3ac5-4e86-9f17-a3ae7f9151f5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:44.031133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ee19-d96b-4863-a812-ab693a6c9c71 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:44.043577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 848/1724] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:44.047246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba62e3-3ac5-4e86-9f17-a3ae7f9151f5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:44.058951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba62e3-3ac5-4e86-9f17-a3ae7f9151f5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:44.064996 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243a2b6-1a01-48bf-bbe9-c50fb64a9277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:44.065948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243a2b6-1a01-48bf-bbe9-c50fb64a9277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.066304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243a2b6-1a01-48bf-bbe9-c50fb64a9277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.066664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243a2b6-1a01-48bf-bbe9-c50fb64a9277 admin admin] PATH_INFO: `/v3/projects/f68d7ec502154c178bd6165be0070eed/users/129ea7a344344c8288e3eebeeea2dcc0/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.070616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:44.088324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243a2b6-1a01-48bf-bbe9-c50fb64a9277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68d7ec502154c178bd6165be0070eed, user_id=129ea7a344344c8288e3eebeeea2dcc0, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:44.091661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243a2b6-1a01-48bf-bbe9-c50fb64a9277 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:44.135348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 849/1725] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:44 2022] PUT /identity/v3/projects/f68d7ec502154c178bd6165be0070eed/users/129ea7a344344c8288e3eebeeea2dcc0/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:44.136572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544c21f-2c02-4b97-a1de-7a93bb7b08db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:44.137211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c21f-2c02-4b97-a1de-7a93bb7b08db service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.137793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c21f-2c02-4b97-a1de-7a93bb7b08db service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.137893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c21f-2c02-4b97-a1de-7a93bb7b08db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.140202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243a2b6-1a01-48bf-bbe9-c50fb64a9277 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:44.140326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3544c21f-2c02-4b97-a1de-7a93bb7b08db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:44.154164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544c21f-2c02-4b97-a1de-7a93bb7b08db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:44.156125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544c21f-2c02-4b97-a1de-7a93bb7b08db service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:44.168636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 877/1726] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:44.244538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243a2b6-1a01-48bf-bbe9-c50fb64a9277 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:44.261170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad4d8-8a4c-434d-b499-0f5b7deb08f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:44.261719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad4d8-8a4c-434d-b499-0f5b7deb08f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.262227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad4d8-8a4c-434d-b499-0f5b7deb08f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.263757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad4d8-8a4c-434d-b499-0f5b7deb08f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.264539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ad4d8-8a4c-434d-b499-0f5b7deb08f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:44.264977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1001814-90bf-4132-8d88-8d6f65518078 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.265340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1001814-90bf-4132-8d88-8d6f65518078 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.265692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1001814-90bf-4132-8d88-8d6f65518078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.266673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ad4d8-8a4c-434d-b499-0f5b7deb08f5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:44.291153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 850/1727] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:44.293084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad4d8-8a4c-434d-b499-0f5b7deb08f5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:44.332756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e1001814-90bf-4132-8d88-8d6f65518078 None None] MFA Rules not processed for user `1e53d46902444c0fb0ab0e56960ff8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:44.334004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e1001814-90bf-4132-8d88-8d6f65518078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:44.353136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad4d8-8a4c-434d-b499-0f5b7deb08f5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:44.366714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79b694-ee36-42eb-89b9-70934bd0f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:44.367797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b694-ee36-42eb-89b9-70934bd0f194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.367928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b694-ee36-42eb-89b9-70934bd0f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.368313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79b694-ee36-42eb-89b9-70934bd0f194 admin admin] PATH_INFO: `/v3/projects/f68d7ec502154c178bd6165be0070eed/users/129ea7a344344c8288e3eebeeea2dcc0/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.372713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79b694-ee36-42eb-89b9-70934bd0f194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68d7ec502154c178bd6165be0070eed, user_id=129ea7a344344c8288e3eebeeea2dcc0, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:44.378303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79b694-ee36-42eb-89b9-70934bd0f194 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:44.415523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 851/1728] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:44 2022] PUT /identity/v3/projects/f68d7ec502154c178bd6165be0070eed/users/129ea7a344344c8288e3eebeeea2dcc0/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:44.417250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2413-1af3-4f2e-bfea-67bbaf539fa5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.417604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2413-1af3-4f2e-bfea-67bbaf539fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.417959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c2413-1af3-4f2e-bfea-67bbaf539fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.485654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e41c2413-1af3-4f2e-bfea-67bbaf539fa5 None None] MFA Rules not processed for user `129ea7a344344c8288e3eebeeea2dcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:44.487324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e41c2413-1af3-4f2e-bfea-67bbaf539fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:44.500239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 878/1729] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:44.515502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1001814-90bf-4132-8d88-8d6f65518078 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:44.516861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e1001814-90bf-4132-8d88-8d6f65518078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:44.549088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:44.686784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1001814-90bf-4132-8d88-8d6f65518078 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:44.781399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 852/1730] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:44.782554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c2413-1af3-4f2e-bfea-67bbaf539fa5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:44.835264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e41c2413-1af3-4f2e-bfea-67bbaf539fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:44.874604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:44.875310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:44.876550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:44.877359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:44.968385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:44.993254 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c2413-1af3-4f2e-bfea-67bbaf539fa5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:45.000387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:45.001102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:45.001385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:45.001385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] PATH_INFO: `/v3/projects/61f3809143a045dda2968dbbcbc58138` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:45.004328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f3809143a045dda2968dbbcbc58138)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:45.006465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:45.074099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:45.075747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:45.098441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 879/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:18:45.100834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:45.105238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:45.148922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f3809143a045dda2968dbbcbc58138', 'request_id': 'req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.161367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05668a17-fd45-46be-9a3c-f64a0ee7fe3e service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:45.191220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f3809143a045dda2968dbbcbc58138', 'request_id': 'req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.224094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f3809143a045dda2968dbbcbc58138', 'request_id': 'req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.255156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] The token cache is being invalidate because project 61f3809143a045dda2968dbbcbc58138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:45.258965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.268325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.276421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 853/1732] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:44 2022] DELETE /identity/v3/projects/61f3809143a045dda2968dbbcbc58138 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:45.286351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:45.292085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:45.405874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:45.450155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94c63e-22ad-4b0d-8b63-1044b5b7161b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:45.471349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:45.472521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:45.474741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:45.475367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:45.476934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:45.478774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:45.479093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:45.479377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] PATH_INFO: `/v3/projects/8d87e689842a43d79caa58de49493553` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:45.480650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:45.483986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d87e689842a43d79caa58de49493553)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:45.496073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:45.644456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:45.646502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:45.677504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 854/1733] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:45.680874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:45.684151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:45.690230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d87e689842a43d79caa58de49493553', 'request_id': 'req-917cb934-fa6b-43bb-b610-3c967ffa8cc8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.710384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d87e689842a43d79caa58de49493553', 'request_id': 'req-917cb934-fa6b-43bb-b610-3c967ffa8cc8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.716670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394deb70-ec3b-4213-a222-4237eff3b157 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:45.726346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d87e689842a43d79caa58de49493553', 'request_id': 'req-917cb934-fa6b-43bb-b610-3c967ffa8cc8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.754835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] The token cache is being invalidate because project 8d87e689842a43d79caa58de49493553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:45.756713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.758645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:45.770001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 880/1734] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:45 2022] DELETE /identity/v3/projects/8d87e689842a43d79caa58de49493553 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:45.773339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:45.779107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:45.819910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:45.889356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:45.890036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:45.890323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:45.890605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] PATH_INFO: `/v3/projects/0ec4c365c27a458884e1a1eaf37aaf7b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:45.893868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec4c365c27a458884e1a1eaf37aaf7b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:45.895865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:46.000946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb934-fa6b-43bb-b610-3c967ffa8cc8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:46.015315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:46.015995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:46.016309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:46.016591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] PATH_INFO: `/v3/users/77146b34a0f14448b43d3ee9d947288c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:46.026269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77146b34a0f14448b43d3ee9d947288c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:46.028482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:46.079886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec4c365c27a458884e1a1eaf37aaf7b', 'request_id': 'req-f3c4a2c1-f438-421f-9186-1701a0549821'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.125303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec4c365c27a458884e1a1eaf37aaf7b', 'request_id': 'req-f3c4a2c1-f438-421f-9186-1701a0549821'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.135039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77146b34a0f14448b43d3ee9d947288c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.151785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec4c365c27a458884e1a1eaf37aaf7b', 'request_id': 'req-f3c4a2c1-f438-421f-9186-1701a0549821'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.158729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77146b34a0f14448b43d3ee9d947288c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.159853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77146b34a0f14448b43d3ee9d947288c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.160850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77146b34a0f14448b43d3ee9d947288c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.177056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] The token cache is being invalidate because project 0ec4c365c27a458884e1a1eaf37aaf7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:46.177354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.178101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f3c4a2c1-f438-421f-9186-1701a0549821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.185723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 855/1735] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:45 2022] DELETE /identity/v3/projects/0ec4c365c27a458884e1a1eaf37aaf7b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:46.187266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb89f-1f40-4e1c-a586-6e6ebdbe6765 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:46.187697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb89f-1f40-4e1c-a586-6e6ebdbe6765 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:46.187978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eb89f-1f40-4e1c-a586-6e6ebdbe6765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:46.195041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77146b34a0f14448b43d3ee9d947288c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.203239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:46.227594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 881/1736] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:45 2022] DELETE /identity/v3/users/77146b34a0f14448b43d3ee9d947288c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:46.229107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:46.230673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:46.295176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-787eb89f-1f40-4e1c-a586-6e6ebdbe6765 None None] MFA Rules not processed for user `0522e5c104c54f75b249ec924b0b08d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:46.296482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-787eb89f-1f40-4e1c-a586-6e6ebdbe6765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:46.429001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 856/1737] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:46.429001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02b572-1a14-4d3e-93f9-f785d9a4773a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:46.429001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02b572-1a14-4d3e-93f9-f785d9a4773a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:46.429001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02b572-1a14-4d3e-93f9-f785d9a4773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:46.478733 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2d02b572-1a14-4d3e-93f9-f785d9a4773a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:46.485177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2d02b572-1a14-4d3e-93f9-f785d9a4773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:46.486643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9a856-ef33-4495-916c-08c09aaf1e86 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:46.515832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:46.515832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:46.515832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:46.515832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] PATH_INFO: `/v3/users/2b29a1905a29431893a371b373b14f4f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:46.516193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 857/1738] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:46.516804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29402d-40f7-4e39-8ca6-cd87c86da5c2 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:46.516920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b29a1905a29431893a371b373b14f4f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:46.517158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29402d-40f7-4e39-8ca6-cd87c86da5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:46.517433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29402d-40f7-4e39-8ca6-cd87c86da5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:46.519893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:46.578866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1c29402d-40f7-4e39-8ca6-cd87c86da5c2 None None] MFA Rules not processed for user `0522e5c104c54f75b249ec924b0b08d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:46.587305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1c29402d-40f7-4e39-8ca6-cd87c86da5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:46.604409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 858/1739] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:46.605817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0d4d8-c70a-4b70-b699-ecb0472952c3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:46.606108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0d4d8-c70a-4b70-b699-ecb0472952c3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:46.606388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0d4d8-c70a-4b70-b699-ecb0472952c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:46.701607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-81b0d4d8-c70a-4b70-b699-ecb0472952c3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:46.702866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-81b0d4d8-c70a-4b70-b699-ecb0472952c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:46.723988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b29a1905a29431893a371b373b14f4f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.742250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 859/1740] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:46.743154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0d4d8-c70a-4b70-b699-ecb0472952c3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:46.746345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-81b0d4d8-c70a-4b70-b699-ecb0472952c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:46.755178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b29a1905a29431893a371b373b14f4f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.755820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b29a1905a29431893a371b373b14f4f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.756589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b29a1905a29431893a371b373b14f4f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.797498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b29a1905a29431893a371b373b14f4f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:46.832287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 882/1741] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:46 2022] DELETE /identity/v3/users/2b29a1905a29431893a371b373b14f4f => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:46.833434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:46.839593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:46.846285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:46.959155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0d4d8-c70a-4b70-b699-ecb0472952c3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:47.058483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d8e577-3ed7-425f-b9b2-2044db475430 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:47.085003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:47.086811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.087236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.089228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.090227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:47.092442 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:47.097493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:47.144748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 883/1742] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:47.146956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:47.151117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:47.193144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:47.193895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.194216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.194593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.204574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:47.217038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64400239-1af7-49de-b589-8c72453f0b2d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:47.222652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:47.223377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.223663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.223954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] PATH_INFO: `/v3/users/235d99909a204a228a2b9121fe7abc03` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.227024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235d99909a204a228a2b9121fe7abc03)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:47.229118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:47.232317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:47.361440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235d99909a204a228a2b9121fe7abc03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:47.393120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235d99909a204a228a2b9121fe7abc03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:47.396145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235d99909a204a228a2b9121fe7abc03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:47.402979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235d99909a204a228a2b9121fe7abc03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:47.404510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:47.406266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:47.427969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 860/1743] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:47.428892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:47.479286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235d99909a204a228a2b9121fe7abc03'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:47.481148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b11082-5fd1-4a92-b4bc-2c86d8f9bec8 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:47.499614 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc30eed-bc46-4f01-a99e-402969abb185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:47.500167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30eed-bc46-4f01-a99e-402969abb185 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.500563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30eed-bc46-4f01-a99e-402969abb185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.500846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc30eed-bc46-4f01-a99e-402969abb185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.502126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc30eed-bc46-4f01-a99e-402969abb185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:47.506754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc30eed-bc46-4f01-a99e-402969abb185 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:47.519732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 884/1744] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:47 2022] DELETE /identity/v3/users/235d99909a204a228a2b9121fe7abc03 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:47.520962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:47.529124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:47.577125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 861/1745] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:47 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:47.578539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607812ea-deeb-45a7-b729-e5d05239fbbb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.578832 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607812ea-deeb-45a7-b729-e5d05239fbbb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.579140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607812ea-deeb-45a7-b729-e5d05239fbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.601101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-607812ea-deeb-45a7-b729-e5d05239fbbb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:47.602744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-607812ea-deeb-45a7-b729-e5d05239fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:47.673343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f177b-cfe2-4f78-af33-f2952230f8d1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:47.687905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:47.781617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 862/1746] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:47.782845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607812ea-deeb-45a7-b729-e5d05239fbbb None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:47.790689 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-607812ea-deeb-45a7-b729-e5d05239fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:47.822417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607812ea-deeb-45a7-b729-e5d05239fbbb None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:47.839152 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:47.839651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.839939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.841117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.841242 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:47.847633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:47.866700 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:47.867561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:47.867814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:47.868166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] PATH_INFO: `/v3/projects/edb83fba718c4f2bb381dbd35adf39e5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:47.874201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edb83fba718c4f2bb381dbd35adf39e5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:47.877447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:47.913513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 863/1747] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:47 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:47.915622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:47.921310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:47.963696 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:48.012909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edb83fba718c4f2bb381dbd35adf39e5', 'request_id': 'req-58448802-46fe-4af3-b8fc-cedc305f5ca9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:48.024058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edb83fba718c4f2bb381dbd35adf39e5', 'request_id': 'req-58448802-46fe-4af3-b8fc-cedc305f5ca9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:48.042574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edb83fba718c4f2bb381dbd35adf39e5', 'request_id': 'req-58448802-46fe-4af3-b8fc-cedc305f5ca9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:48.068443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] The token cache is being invalidate because project edb83fba718c4f2bb381dbd35adf39e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:48.069156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:48.070834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:48.078315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 885/1748] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:47 2022] DELETE /identity/v3/projects/edb83fba718c4f2bb381dbd35adf39e5 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:48.078696 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:48.083070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.157385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc9dc-09be-461d-8129-f44cf8f74abc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:48.207861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58448802-46fe-4af3-b8fc-cedc305f5ca9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:48.213107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6def56-47f2-4009-a493-4ff1c0dc76ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:48.213740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6def56-47f2-4009-a493-4ff1c0dc76ab admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.214021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6def56-47f2-4009-a493-4ff1c0dc76ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.214296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6def56-47f2-4009-a493-4ff1c0dc76ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.214951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6def56-47f2-4009-a493-4ff1c0dc76ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:48.219959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6def56-47f2-4009-a493-4ff1c0dc76ab admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:48.242233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 886/1749] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:48.247089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d35a1-8d8f-4843-ac4b-985cadf6f515 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.247500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d35a1-8d8f-4843-ac4b-985cadf6f515 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.247835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d35a1-8d8f-4843-ac4b-985cadf6f515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.281131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-897d35a1-8d8f-4843-ac4b-985cadf6f515 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:48.287421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-897d35a1-8d8f-4843-ac4b-985cadf6f515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.308795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 887/1750] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:48.310902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d35a1-8d8f-4843-ac4b-985cadf6f515 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:48.321018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ce577-35a4-47db-a5d2-39b8c9fc4092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:48.321705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce577-35a4-47db-a5d2-39b8c9fc4092 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.321939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce577-35a4-47db-a5d2-39b8c9fc4092 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.322219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce577-35a4-47db-a5d2-39b8c9fc4092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.332366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-603ce577-35a4-47db-a5d2-39b8c9fc4092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.339924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d35a1-8d8f-4843-ac4b-985cadf6f515 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:48.356130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c72a00-22db-4477-8fe7-6a25a9270692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:48.356790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ce577-35a4-47db-a5d2-39b8c9fc4092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:48.357297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72a00-22db-4477-8fe7-6a25a9270692 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.357722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72a00-22db-4477-8fe7-6a25a9270692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.358141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72a00-22db-4477-8fe7-6a25a9270692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.358265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ce577-35a4-47db-a5d2-39b8c9fc4092 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:48.359085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c72a00-22db-4477-8fe7-6a25a9270692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:48.363642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c72a00-22db-4477-8fe7-6a25a9270692 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:48.396087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 864/1751] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:48.397311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 888/1752] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:48.398238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c72a00-22db-4477-8fe7-6a25a9270692 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:48.398924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509361-289a-4fed-9ba2-a5f80602da59 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.399386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509361-289a-4fed-9ba2-a5f80602da59 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.402841 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42509361-289a-4fed-9ba2-a5f80602da59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.421789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c72a00-22db-4477-8fe7-6a25a9270692 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:48.443189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d1cb7-e1e9-4d2a-bc72-595536ec0cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:48.444183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1cb7-e1e9-4d2a-bc72-595536ec0cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.444469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1cb7-e1e9-4d2a-bc72-595536ec0cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.444746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d1cb7-e1e9-4d2a-bc72-595536ec0cf1 admin admin] PATH_INFO: `/v3/projects/599e81b9a2c444debd4750dfd17b15fa/users/45b31534d7e447eca9c9105ac0ab84bc/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.447347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-42509361-289a-4fed-9ba2-a5f80602da59 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:48.452288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-42509361-289a-4fed-9ba2-a5f80602da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.474174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 865/1753] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:48.479146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509361-289a-4fed-9ba2-a5f80602da59 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:48.479865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d1cb7-e1e9-4d2a-bc72-595536ec0cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599e81b9a2c444debd4750dfd17b15fa, user_id=45b31534d7e447eca9c9105ac0ab84bc, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:48.482552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d1cb7-e1e9-4d2a-bc72-595536ec0cf1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:48.505768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42509361-289a-4fed-9ba2-a5f80602da59 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:48.513017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:48.513905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.514334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.514755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.515590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:48.516582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:48.519216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:48.526047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 889/1754] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:48 2022] PUT /identity/v3/projects/599e81b9a2c444debd4750dfd17b15fa/users/45b31534d7e447eca9c9105ac0ab84bc/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:48.527659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6e7e-aaa6-4333-9e13-a33d04961d59 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.527933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6e7e-aaa6-4333-9e13-a33d04961d59 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.529507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa6e7e-aaa6-4333-9e13-a33d04961d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.546829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 866/1755] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:48.558224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:48.594012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edac15-ef45-4f7f-823b-a8d43762a66d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:48.609213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-beaa6e7e-aaa6-4333-9e13-a33d04961d59 None None] MFA Rules not processed for user `45b31534d7e447eca9c9105ac0ab84bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:48.613654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-beaa6e7e-aaa6-4333-9e13-a33d04961d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.781958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefa01b-af5a-4599-978a-96c41584e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:48.782704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefa01b-af5a-4599-978a-96c41584e7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.783015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefa01b-af5a-4599-978a-96c41584e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.783330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefa01b-af5a-4599-978a-96c41584e7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.784546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefa01b-af5a-4599-978a-96c41584e7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:48.789066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefa01b-af5a-4599-978a-96c41584e7e1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:48.791671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 890/1756] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:48.795163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa6e7e-aaa6-4333-9e13-a33d04961d59 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:48.796185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-beaa6e7e-aaa6-4333-9e13-a33d04961d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:48.807182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:48.819614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa6e7e-aaa6-4333-9e13-a33d04961d59 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:48.827631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:48.828861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:48.829395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:48.830403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] PATH_INFO: `/v3/projects/31aa08a513254b33850c8848a43a83e9` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:48.832166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31aa08a513254b33850c8848a43a83e9)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:48.832901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:48.835151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:48.860967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 867/1757] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:48 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:48.861860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefa01b-af5a-4599-978a-96c41584e7e1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:48.917707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31aa08a513254b33850c8848a43a83e9', 'request_id': 'req-bd2bc6d8-6159-4402-8b01-4093fe158ef0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:48.928815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31aa08a513254b33850c8848a43a83e9', 'request_id': 'req-bd2bc6d8-6159-4402-8b01-4093fe158ef0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:48.951775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31aa08a513254b33850c8848a43a83e9', 'request_id': 'req-bd2bc6d8-6159-4402-8b01-4093fe158ef0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:49.005948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] The token cache is being invalidate because project 31aa08a513254b33850c8848a43a83e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:49.009752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:49.012596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:49.018229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 891/1758] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:48 2022] DELETE /identity/v3/projects/31aa08a513254b33850c8848a43a83e9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:49.020006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:49.027768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:49.049087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefa01b-af5a-4599-978a-96c41584e7e1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:49.210543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db774d71-e70a-4edb-a223-9c05741e7e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:49.211373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774d71-e70a-4edb-a223-9c05741e7e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.211667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774d71-e70a-4edb-a223-9c05741e7e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.212617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bc6d8-6159-4402-8b01-4093fe158ef0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:49.213198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db774d71-e70a-4edb-a223-9c05741e7e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.214240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db774d71-e70a-4edb-a223-9c05741e7e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:49.218245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367395c-78e9-4cec-9f3e-a3fba59a8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:49.219114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367395c-78e9-4cec-9f3e-a3fba59a8534 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.219225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db774d71-e70a-4edb-a223-9c05741e7e24 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:49.219570 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367395c-78e9-4cec-9f3e-a3fba59a8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.220544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367395c-78e9-4cec-9f3e-a3fba59a8534 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.221297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367395c-78e9-4cec-9f3e-a3fba59a8534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:49.223625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367395c-78e9-4cec-9f3e-a3fba59a8534 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:49.303418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 892/1759] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:49 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:49.311799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b688d4-e2c5-4bca-bc6e-dcf2f6054d9a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.314279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b688d4-e2c5-4bca-bc6e-dcf2f6054d9a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.317784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b688d4-e2c5-4bca-bc6e-dcf2f6054d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.321538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 868/1760] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:48 2022] POST /identity/v3/projects => generated 367 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:49.325606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fcf3e-9188-483b-a5c9-40c6e9cd990d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.326087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fcf3e-9188-483b-a5c9-40c6e9cd990d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.326377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fcf3e-9188-483b-a5c9-40c6e9cd990d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.367334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2c9fcf3e-9188-483b-a5c9-40c6e9cd990d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:49.368783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2c9fcf3e-9188-483b-a5c9-40c6e9cd990d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:49.520544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c8b688d4-e2c5-4bca-bc6e-dcf2f6054d9a None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:49.522805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c8b688d4-e2c5-4bca-bc6e-dcf2f6054d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:49.544648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 869/1761] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:49.546452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fcf3e-9188-483b-a5c9-40c6e9cd990d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:49.559051 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fcf3e-9188-483b-a5c9-40c6e9cd990d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:49.566552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:49.567437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.567840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.568160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.569003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:49.572025 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:49.586772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 870/1762] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:49.587926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:49.591035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:49.626107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868208bd-7bbd-4636-ad1a-962ae3592000 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:49.643539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6534e7c-bfd4-4748-a83d-b353f225abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:49.644172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534e7c-bfd4-4748-a83d-b353f225abe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.644453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534e7c-bfd4-4748-a83d-b353f225abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.644730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534e7c-bfd4-4748-a83d-b353f225abe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.645377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534e7c-bfd4-4748-a83d-b353f225abe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:49.647368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534e7c-bfd4-4748-a83d-b353f225abe5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:49.656838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:49.699902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:49.706674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 893/1763] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:49.713071 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 871/1764] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:49 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:49.722908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e725c40-9796-4d2e-b81c-151687b263dd None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.723247 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e725c40-9796-4d2e-b81c-151687b263dd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.723530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e725c40-9796-4d2e-b81c-151687b263dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.727098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1d14-6b44-4c7a-b1cf-759ed13da33b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.727949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1d14-6b44-4c7a-b1cf-759ed13da33b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.728247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a1d14-6b44-4c7a-b1cf-759ed13da33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.788458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-144a1d14-6b44-4c7a-b1cf-759ed13da33b None None] MFA Rules not processed for user `0522e5c104c54f75b249ec924b0b08d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:49.789787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-144a1d14-6b44-4c7a-b1cf-759ed13da33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:49.792364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4e725c40-9796-4d2e-b81c-151687b263dd None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:49.793547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4e725c40-9796-4d2e-b81c-151687b263dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:49.812666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 872/1765] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:49.813785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e725c40-9796-4d2e-b81c-151687b263dd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:49.843621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e725c40-9796-4d2e-b81c-151687b263dd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:49.857990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad6e6-8670-409b-a2fc-4a846500458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:49.858608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad6e6-8670-409b-a2fc-4a846500458e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.859197 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad6e6-8670-409b-a2fc-4a846500458e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.860406 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bad6e6-8670-409b-a2fc-4a846500458e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.862349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bad6e6-8670-409b-a2fc-4a846500458e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:49.864520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bad6e6-8670-409b-a2fc-4a846500458e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:49.899713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 873/1766] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:49.900804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad6e6-8670-409b-a2fc-4a846500458e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:49.923857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bad6e6-8670-409b-a2fc-4a846500458e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:49.935895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f15aa1-8cc6-4cfb-980a-acfb5b271e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:49.936520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f15aa1-8cc6-4cfb-980a-acfb5b271e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:49.936818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f15aa1-8cc6-4cfb-980a-acfb5b271e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:49.937065 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f15aa1-8cc6-4cfb-980a-acfb5b271e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:49.940692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 894/1767] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:49.941579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a1d14-6b44-4c7a-b1cf-759ed13da33b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:49.942687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f15aa1-8cc6-4cfb-980a-acfb5b271e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:49.945729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f15aa1-8cc6-4cfb-980a-acfb5b271e2b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:49.980425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a1d14-6b44-4c7a-b1cf-759ed13da33b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:49.982035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 874/1768] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:49.987807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f15aa1-8cc6-4cfb-980a-acfb5b271e2b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:50.006125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:50.008092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:50.008396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:50.009233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:50.012163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:50.013094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:50.023479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:50.035258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f15aa1-8cc6-4cfb-980a-acfb5b271e2b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:50.060457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:50.062858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:50.063842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:50.066868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] PATH_INFO: `/v3/projects/99af48fd3aae4f7bb17f16a1e633cfa0/users/6ed2697a647c49ad8811cb7bda347725/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:50.119724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 895/1769] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:18:50.121001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:50.181552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] RBAC: Authorizing `identity:create_grant(project_id=99af48fd3aae4f7bb17f16a1e633cfa0, user_id=6ed2697a647c49ad8811cb7bda347725, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:50.182591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75c2c1-88e0-42ad-9750-8d583524226c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:50.196754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:50.202335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609ba80-56f4-419d-b371-695be2fee8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:50.206475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609ba80-56f4-419d-b371-695be2fee8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:50.206740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609ba80-56f4-419d-b371-695be2fee8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:50.209508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609ba80-56f4-419d-b371-695be2fee8c3 admin admin] PATH_INFO: `/v3/projects/cd1faac81a534863b4eabead1277d1a8/users/f4c7df90ddca4d66a1bed4d9594b4b06/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:50.268941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 875/1770] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:49 2022] PUT /identity/v3/projects/99af48fd3aae4f7bb17f16a1e633cfa0/users/6ed2697a647c49ad8811cb7bda347725/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:50.270059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:50.279922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:50.295925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609ba80-56f4-419d-b371-695be2fee8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1faac81a534863b4eabead1277d1a8, user_id=f4c7df90ddca4d66a1bed4d9594b4b06, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:50.301615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609ba80-56f4-419d-b371-695be2fee8c3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:50.421804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 896/1771] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:50 2022] PUT /identity/v3/projects/cd1faac81a534863b4eabead1277d1a8/users/f4c7df90ddca4d66a1bed4d9594b4b06/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:50.422875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609ba80-56f4-419d-b371-695be2fee8c3 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:50.653087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609ba80-56f4-419d-b371-695be2fee8c3 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:50.657072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3345f-16a8-4f31-bdfd-e1695a9e627b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:50.668080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:50.668712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:50.668986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:50.669912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:50.670823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:50.674689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:50.759433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 897/1772] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:50 2022] POST /identity/v3/projects => generated 375 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:50.761601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:50.766458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:50.855924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83113f17-fb55-41a8-94a0-920b0d5e8ea7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:50.856564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113f17-fb55-41a8-94a0-920b0d5e8ea7 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:50.856843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113f17-fb55-41a8-94a0-920b0d5e8ea7 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:50.857118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83113f17-fb55-41a8-94a0-920b0d5e8ea7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:50.904318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:50.950358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:50.960944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938672dc-602d-4b03-876b-9008b4b25ce7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:50.976807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:50.977892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:50.977892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:50.978107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] PATH_INFO: `/v3/projects/0944823195bd44ce80d3f70d39209fb5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:50.980996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0944823195bd44ce80d3f70d39209fb5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:50.989398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:51.038518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83113f17-fb55-41a8-94a0-920b0d5e8ea7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:51.041896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83113f17-fb55-41a8-94a0-920b0d5e8ea7 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:51.061414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 876/1773] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:18:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:18:51.062619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb97f29-5f1d-4254-934c-f934e5d77514 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:51.062972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb97f29-5f1d-4254-934c-f934e5d77514 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:51.063367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb97f29-5f1d-4254-934c-f934e5d77514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:51.091025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0944823195bd44ce80d3f70d39209fb5', 'request_id': 'req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.128424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0944823195bd44ce80d3f70d39209fb5', 'request_id': 'req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.159520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0944823195bd44ce80d3f70d39209fb5', 'request_id': 'req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.164586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7cb97f29-5f1d-4254-934c-f934e5d77514 None None] MFA Rules not processed for user `6ed2697a647c49ad8811cb7bda347725`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:51.167656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7cb97f29-5f1d-4254-934c-f934e5d77514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:51.226942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] The token cache is being invalidate because project 0944823195bd44ce80d3f70d39209fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:51.227499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.228591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.233595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 898/1774] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:50 2022] DELETE /identity/v3/projects/0944823195bd44ce80d3f70d39209fb5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:51.234802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:51.238160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:51.450093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 877/1775] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:51.454540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb97f29-5f1d-4254-934c-f934e5d77514 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:51.472434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7cb97f29-5f1d-4254-934c-f934e5d77514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:51.494712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53e58f-7f2a-4696-9bf9-6adc10f4299e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:51.516525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:51.521564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:51.524029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:51.524029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:51.524764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:51.536719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:51.542908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb97f29-5f1d-4254-934c-f934e5d77514 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:51.567550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 899/1776] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:51.570156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:51.571945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:51.576333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:51.577645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:51.578002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:51.580157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:51.584923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:51.590828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:51.621831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f366da-a9ad-4432-9345-d18a7c15b730 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:51.635570 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:51.636310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:51.637733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:51.638031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] PATH_INFO: `/v3/users/129ea7a344344c8288e3eebeeea2dcc0` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:51.646006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=129ea7a344344c8288e3eebeeea2dcc0)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:51.647621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:51.707734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 878/1777] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:51 2022] POST /identity/v3/users => generated 288 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:51.712530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:51.722288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:51.802754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2798401-fe27-4f7f-b3aa-44e0f772705a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:51.845976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:51.847030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:51.847378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:51.847662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:51.849812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:51.852068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:51.910375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129ea7a344344c8288e3eebeeea2dcc0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.932389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129ea7a344344c8288e3eebeeea2dcc0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.935767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129ea7a344344c8288e3eebeeea2dcc0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.935767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129ea7a344344c8288e3eebeeea2dcc0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:51.959647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:51.965317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 879/1778] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:51 2022] POST /identity/v3/projects => generated 389 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:51.965317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:51.967798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:52.003769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129ea7a344344c8288e3eebeeea2dcc0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:52.084054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 900/1779] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:51 2022] DELETE /identity/v3/users/129ea7a344344c8288e3eebeeea2dcc0 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:52.086880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:52.091112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:52.192002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f32e6c-7f87-4192-8e21-519368020952 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:52.279272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:52.358320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15b1b-e64b-4a12-a29f-99619859e9cd admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:52.375629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:52.377488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:52.378082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:52.378644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:52.379834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:52.385865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:52.393149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfe3d3-17dc-431b-a027-2c101517fa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:52.393879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe3d3-17dc-431b-a027-2c101517fa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:52.396837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe3d3-17dc-431b-a027-2c101517fa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:52.399120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfe3d3-17dc-431b-a027-2c101517fa03 admin admin] PATH_INFO: `/v3/projects/cd1faac81a534863b4eabead1277d1a8/users/f4c7df90ddca4d66a1bed4d9594b4b06/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:52.408182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe3d3-17dc-431b-a027-2c101517fa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1faac81a534863b4eabead1277d1a8, user_id=f4c7df90ddca4d66a1bed4d9594b4b06, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:52.417802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 901/1780] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:52.418091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfe3d3-17dc-431b-a027-2c101517fa03 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:52.422126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:52.441515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:52.483043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 880/1781] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:51 2022] PUT /identity/v3/projects/cd1faac81a534863b4eabead1277d1a8/users/f4c7df90ddca4d66a1bed4d9594b4b06/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:52.483043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfe3d3-17dc-431b-a027-2c101517fa03 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:52.491670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e3ed3-c0c4-4a77-8aa3-57e5b1a8408f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:52.616893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfe3d3-17dc-431b-a027-2c101517fa03 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:52.630707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e55dc9-0e02-444a-97e4-acb8892c66fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:52.631448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e55dc9-0e02-444a-97e4-acb8892c66fe admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:52.632206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e55dc9-0e02-444a-97e4-acb8892c66fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:52.632557 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e55dc9-0e02-444a-97e4-acb8892c66fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:52.633141 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e55dc9-0e02-444a-97e4-acb8892c66fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:52.637004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e55dc9-0e02-444a-97e4-acb8892c66fe admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:52.641178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe283-9786-4300-b241-32bc4f3262c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:52.646002 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe283-9786-4300-b241-32bc4f3262c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:52.647382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe283-9786-4300-b241-32bc4f3262c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:52.648548 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe283-9786-4300-b241-32bc4f3262c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:52.652000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe283-9786-4300-b241-32bc4f3262c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:52.659612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe283-9786-4300-b241-32bc4f3262c3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:52.660743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 881/1782] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:52.667834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094711e-887c-41f1-a379-5954952a5f95 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:52.670767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094711e-887c-41f1-a379-5954952a5f95 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:52.671751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094711e-887c-41f1-a379-5954952a5f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:52.746309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 902/1783] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:52 2022] POST /identity/v3/users => generated 301 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:52.751904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe283-9786-4300-b241-32bc4f3262c3 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:52.756794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6094711e-887c-41f1-a379-5954952a5f95 None None] MFA Rules not processed for user `f4c7df90ddca4d66a1bed4d9594b4b06`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:52.761569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6094711e-887c-41f1-a379-5954952a5f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:52.792613 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe283-9786-4300-b241-32bc4f3262c3 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:52.802248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1a1c-2d94-47c3-8829-52c21df4b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:52.804154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1a1c-2d94-47c3-8829-52c21df4b24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:52.804975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1a1c-2d94-47c3-8829-52c21df4b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:52.805643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e1a1c-2d94-47c3-8829-52c21df4b24a admin admin] PATH_INFO: `/v3/projects/f91ff4c7267545b4b0a3686c9727e27d/users/b51d31f51253453797955e7ff7714a0f/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:52.871026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1a1c-2d94-47c3-8829-52c21df4b24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91ff4c7267545b4b0a3686c9727e27d, user_id=b51d31f51253453797955e7ff7714a0f, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:52.887185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e1a1c-2d94-47c3-8829-52c21df4b24a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:52.931670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 903/1784] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:52 2022] PUT /identity/v3/projects/f91ff4c7267545b4b0a3686c9727e27d/users/b51d31f51253453797955e7ff7714a0f/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:52.951012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1a1c-2d94-47c3-8829-52c21df4b24a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:53.041871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 882/1785] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:53.041871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf769f-779a-47c0-9e76-984c6e7d8d21 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:53.042429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf769f-779a-47c0-9e76-984c6e7d8d21 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:53.043255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf769f-779a-47c0-9e76-984c6e7d8d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:53.086127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8faf769f-779a-47c0-9e76-984c6e7d8d21 None None] MFA Rules not processed for user `1e53d46902444c0fb0ab0e56960ff8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:53.087628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8faf769f-779a-47c0-9e76-984c6e7d8d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:53.106431 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:53.207615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e1a1c-2d94-47c3-8829-52c21df4b24a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:53.239049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616745c-fa72-4145-9e42-ab32804532df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:53.240777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:53.242320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616745c-fa72-4145-9e42-ab32804532df admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:53.242654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616745c-fa72-4145-9e42-ab32804532df admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:53.242935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616745c-fa72-4145-9e42-ab32804532df admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:53.245895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616745c-fa72-4145-9e42-ab32804532df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:53.254672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616745c-fa72-4145-9e42-ab32804532df admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:53.286231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 904/1786] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:53.315872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 883/1787] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:53.315872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068f42b-c197-4ac7-b716-cf2d2b5c7d31 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:53.316367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068f42b-c197-4ac7-b716-cf2d2b5c7d31 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:53.316476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068f42b-c197-4ac7-b716-cf2d2b5c7d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:53.319328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7f15f-54dd-4573-87e8-a37b2b7d753c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:53.319697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7f15f-54dd-4573-87e8-a37b2b7d753c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:53.319982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7f15f-54dd-4573-87e8-a37b2b7d753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:53.406114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5068f42b-c197-4ac7-b716-cf2d2b5c7d31 None None] MFA Rules not processed for user `b51d31f51253453797955e7ff7714a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:53.413266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5068f42b-c197-4ac7-b716-cf2d2b5c7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:53.455722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3bc7f15f-54dd-4573-87e8-a37b2b7d753c None None] MFA Rules not processed for user `1c0ab0eca7de4bed89b5f292a52f8c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:53.459278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3bc7f15f-54dd-4573-87e8-a37b2b7d753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:53.728169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 884/1788] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:53.734013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068f42b-c197-4ac7-b716-cf2d2b5c7d31 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:53.743973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5068f42b-c197-4ac7-b716-cf2d2b5c7d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:53.815092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 905/1789] 10.222.0.25 () {58 vars in 1015 bytes} [Fri Sep 16 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:53.817869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7f15f-54dd-4573-87e8-a37b2b7d753c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:53.889977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7f15f-54dd-4573-87e8-a37b2b7d753c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:53.920748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:53.927237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:53.927639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:53.931184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] PATH_INFO: `/v3/projects/50bac462fda44022889e762a0d5e7f95/users/2218c972cb604fc7a59344ece17aaf59/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:53.976134 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068f42b-c197-4ac7-b716-cf2d2b5c7d31 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:53.991667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:53.992321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:53.992613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:53.993007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:54.022634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bac462fda44022889e762a0d5e7f95, user_id=2218c972cb604fc7a59344ece17aaf59, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:54.026693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:54.067432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 906/1790] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:53 2022] PUT /identity/v3/projects/50bac462fda44022889e762a0d5e7f95/users/2218c972cb604fc7a59344ece17aaf59/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:54.069208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:54.076550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:54.160697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:54.162615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:54.187401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 885/1791] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:54.188783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:54.197587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:54.229773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbe32e-56fb-48bb-b4e7-4940076073ac service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:54.291802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6886d2c-0ca4-459b-8307-bf0a0ed54420 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:54.292346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:54.326497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635758b5-1d73-4315-be93-7fa5ab465c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:54.330889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635758b5-1d73-4315-be93-7fa5ab465c1c service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:54.332543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635758b5-1d73-4315-be93-7fa5ab465c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:54.334446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635758b5-1d73-4315-be93-7fa5ab465c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:54.378150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cbe6c-b97f-45a5-88ff-c8a0b6bd2553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:54.383924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbe6c-b97f-45a5-88ff-c8a0b6bd2553 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:54.384534 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbe6c-b97f-45a5-88ff-c8a0b6bd2553 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:54.385018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbe6c-b97f-45a5-88ff-c8a0b6bd2553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:54.410645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cbe6c-b97f-45a5-88ff-c8a0b6bd2553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:54.414129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cbe6c-b97f-45a5-88ff-c8a0b6bd2553 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:54.445304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 886/1792] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:54.447611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cbe6c-b97f-45a5-88ff-c8a0b6bd2553 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:54.667476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cbe6c-b97f-45a5-88ff-c8a0b6bd2553 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:54.692404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:54.694002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:54.696204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:54.696647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:54.697513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:54.700109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:54.739368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 887/1793] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:54.741281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:54.761623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:54.812851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dd7eb-f01d-4081-9923-5eed5d348fcf admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:54.820229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615f781-b629-40ed-8ff7-28e89fe1ca6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:54.822571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615f781-b629-40ed-8ff7-28e89fe1ca6e service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:54.834272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615f781-b629-40ed-8ff7-28e89fe1ca6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:54.834728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615f781-b629-40ed-8ff7-28e89fe1ca6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:54.834855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635758b5-1d73-4315-be93-7fa5ab465c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:54.837675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635758b5-1d73-4315-be93-7fa5ab465c1c service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:54.870817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615f781-b629-40ed-8ff7-28e89fe1ca6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:54.874544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615f781-b629-40ed-8ff7-28e89fe1ca6e service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:54.898433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 907/1794] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 830 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:54.903086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 888/1795] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:54.906142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615f781-b629-40ed-8ff7-28e89fe1ca6e service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:54.929058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615f781-b629-40ed-8ff7-28e89fe1ca6e service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:54.937338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def3dcd-ec04-400b-8aee-ff25db37b541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:54.938376 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def3dcd-ec04-400b-8aee-ff25db37b541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:54.940073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def3dcd-ec04-400b-8aee-ff25db37b541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:54.940613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def3dcd-ec04-400b-8aee-ff25db37b541 admin admin] PATH_INFO: `/v3/projects/50bac462fda44022889e762a0d5e7f95/users/2218c972cb604fc7a59344ece17aaf59/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:54.943767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def3dcd-ec04-400b-8aee-ff25db37b541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bac462fda44022889e762a0d5e7f95, user_id=2218c972cb604fc7a59344ece17aaf59, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:54.949230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def3dcd-ec04-400b-8aee-ff25db37b541 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:54.978665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 889/1796] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:54 2022] PUT /identity/v3/projects/50bac462fda44022889e762a0d5e7f95/users/2218c972cb604fc7a59344ece17aaf59/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:54.980020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833958-ceba-4ace-bd6e-e2885ec6faf5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:54.980361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833958-ceba-4ace-bd6e-e2885ec6faf5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:54.983801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833958-ceba-4ace-bd6e-e2885ec6faf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:55.155336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-49833958-ceba-4ace-bd6e-e2885ec6faf5 None None] MFA Rules not processed for user `2218c972cb604fc7a59344ece17aaf59`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:55.165180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-49833958-ceba-4ace-bd6e-e2885ec6faf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:55.190840 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:55.490865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 908/1797] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:55.508004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def3dcd-ec04-400b-8aee-ff25db37b541 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:55.740889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def3dcd-ec04-400b-8aee-ff25db37b541 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:55.754111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036376f5-a2e2-4aad-9f92-e41a30c0904f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:55.756667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036376f5-a2e2-4aad-9f92-e41a30c0904f service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:55.757043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036376f5-a2e2-4aad-9f92-e41a30c0904f service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:55.759039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036376f5-a2e2-4aad-9f92-e41a30c0904f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:55.786515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036376f5-a2e2-4aad-9f92-e41a30c0904f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:55.789489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036376f5-a2e2-4aad-9f92-e41a30c0904f service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:55.828114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833958-ceba-4ace-bd6e-e2885ec6faf5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:55.830331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-49833958-ceba-4ace-bd6e-e2885ec6faf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:55.849462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 890/1798] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:56.152677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833958-ceba-4ace-bd6e-e2885ec6faf5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:56.172528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:56.178933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:56.179232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:56.179512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] PATH_INFO: `/v3/projects/f68d7ec502154c178bd6165be0070eed` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:56.184732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68d7ec502154c178bd6165be0070eed)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:56.191435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:56.379076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036376f5-a2e2-4aad-9f92-e41a30c0904f service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:56.382502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68d7ec502154c178bd6165be0070eed', 'request_id': 'req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.401914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036376f5-a2e2-4aad-9f92-e41a30c0904f service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:56.410091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68d7ec502154c178bd6165be0070eed', 'request_id': 'req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.451098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68d7ec502154c178bd6165be0070eed', 'request_id': 'req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.477752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] The token cache is being invalidate because project f68d7ec502154c178bd6165be0070eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:18:56.478531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.479995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1775d7b7-2ba4-4f29-9ba7-9d5dcd7f68e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.502625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 909/1799] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:18:55 2022] DELETE /identity/v3/projects/f68d7ec502154c178bd6165be0070eed => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:18:56.506750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc757818-cc1e-4f15-b4c8-f2f08f273fd0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:56.507259 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc757818-cc1e-4f15-b4c8-f2f08f273fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:56.507646 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc757818-cc1e-4f15-b4c8-f2f08f273fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:56.590108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fc757818-cc1e-4f15-b4c8-f2f08f273fd0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:56.592568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fc757818-cc1e-4f15-b4c8-f2f08f273fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:56.661915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:56.769121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:56.769793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:56.770096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:56.770411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] PATH_INFO: `/v3/users/6ed2697a647c49ad8811cb7bda347725` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:56.778172 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:56.787570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed2697a647c49ad8811cb7bda347725)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:56.789591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:56.937409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 910/1800] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:56.945807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9b1b4-7e4e-4a06-b574-564a6b1376b6 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:56.946307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed2697a647c49ad8811cb7bda347725'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.954738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9b1b4-7e4e-4a06-b574-564a6b1376b6 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:56.960038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9b1b4-7e4e-4a06-b574-564a6b1376b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:56.972204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed2697a647c49ad8811cb7bda347725'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.976271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed2697a647c49ad8811cb7bda347725'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.977271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed2697a647c49ad8811cb7bda347725'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:56.987249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-109eb752-3e9a-4d16-9cd3-233c8229ed9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed2697a647c49ad8811cb7bda347725'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:57.055465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 891/1801] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:56 2022] DELETE /identity/v3/users/6ed2697a647c49ad8811cb7bda347725 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:18:57.060278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa827-2281-4031-ba5c-335470dbe828 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:57.060435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa827-2281-4031-ba5c-335470dbe828 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:57.060722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa827-2281-4031-ba5c-335470dbe828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:57.100066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8fb9b1b4-7e4e-4a06-b574-564a6b1376b6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:57.103876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-780aa827-2281-4031-ba5c-335470dbe828 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:57.105272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-780aa827-2281-4031-ba5c-335470dbe828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:57.107888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8fb9b1b4-7e4e-4a06-b574-564a6b1376b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:57.308785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 892/1802] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:18:57.493072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 911/1803] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:57.493569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aa827-2281-4031-ba5c-335470dbe828 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:57.494047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9b1b4-7e4e-4a06-b574-564a6b1376b6 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:57.496101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8fb9b1b4-7e4e-4a06-b574-564a6b1376b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:57.520238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aa827-2281-4031-ba5c-335470dbe828 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:57.552563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:57.553211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:57.553481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:57.553808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:57.557603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:18:57.557933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:57.559621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:57.634249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 893/1804] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:18:57.644129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:57.735917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef4211-b27d-42f8-80c3-d42b178d017c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:57.737455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9b1b4-7e4e-4a06-b574-564a6b1376b6 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:57.757800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249ec5-0921-43cc-a07d-652094484bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:57.758484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249ec5-0921-43cc-a07d-652094484bcc service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:57.758765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249ec5-0921-43cc-a07d-652094484bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:57.759058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249ec5-0921-43cc-a07d-652094484bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:57.761887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4201b0a-9bc0-4447-b956-a0053c906a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:57.762902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4201b0a-9bc0-4447-b956-a0053c906a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:57.764869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4201b0a-9bc0-4447-b956-a0053c906a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:57.765297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4201b0a-9bc0-4447-b956-a0053c906a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:57.766096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4201b0a-9bc0-4447-b956-a0053c906a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:57.772919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4201b0a-9bc0-4447-b956-a0053c906a9d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:57.795630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6249ec5-0921-43cc-a07d-652094484bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:57.800492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6249ec5-0921-43cc-a07d-652094484bcc service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:57.851352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 912/1805] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:18:57.888746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 894/1806] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:57 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:57.894675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249ec5-0921-43cc-a07d-652094484bcc service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:57.926133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6249ec5-0921-43cc-a07d-652094484bcc service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:58.179059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf08e83-7b59-4294-a2b6-0fa2fcae2af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:58.179705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08e83-7b59-4294-a2b6-0fa2fcae2af2 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:58.182290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08e83-7b59-4294-a2b6-0fa2fcae2af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:58.183210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08e83-7b59-4294-a2b6-0fa2fcae2af2 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:58.183210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf08e83-7b59-4294-a2b6-0fa2fcae2af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:58.188522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf08e83-7b59-4294-a2b6-0fa2fcae2af2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:58.255222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 913/1807] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:57 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:58.256740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4201b0a-9bc0-4447-b956-a0053c906a9d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:58.277191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4201b0a-9bc0-4447-b956-a0053c906a9d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:58.294672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27082699-787f-4d64-be64-1dcab45177c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:58.295506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27082699-787f-4d64-be64-1dcab45177c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:58.295981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27082699-787f-4d64-be64-1dcab45177c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:58.296475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27082699-787f-4d64-be64-1dcab45177c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:58.300118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27082699-787f-4d64-be64-1dcab45177c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:58.302201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27082699-787f-4d64-be64-1dcab45177c4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:58.357748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 895/1808] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:58.358797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf08e83-7b59-4294-a2b6-0fa2fcae2af2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:58.367878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:58.384401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf08e83-7b59-4294-a2b6-0fa2fcae2af2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:58.406015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8d16-9301-48a2-9c22-e8ce090bcc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:58.410694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8d16-9301-48a2-9c22-e8ce090bcc93 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:58.411763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8d16-9301-48a2-9c22-e8ce090bcc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:58.412453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8d16-9301-48a2-9c22-e8ce090bcc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:58.415009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c8d16-9301-48a2-9c22-e8ce090bcc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:58.445255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c8d16-9301-48a2-9c22-e8ce090bcc93 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:58.496468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27082699-787f-4d64-be64-1dcab45177c4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:58.514098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27082699-787f-4d64-be64-1dcab45177c4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:58.514460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 914/1809] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:58.533702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3667-bb3c-4b3e-9b79-bfb42140f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:58.534480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3667-bb3c-4b3e-9b79-bfb42140f0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:58.537282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3667-bb3c-4b3e-9b79-bfb42140f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:58.537685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe3667-bb3c-4b3e-9b79-bfb42140f0fb admin admin] PATH_INFO: `/v3/projects/c8eab79750bd48ea929899b175d67ad8/users/91899339931a4e609ceb438dd02238aa/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:58.586151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:58.600173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe3667-bb3c-4b3e-9b79-bfb42140f0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8eab79750bd48ea929899b175d67ad8, user_id=91899339931a4e609ceb438dd02238aa, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:58.609642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe3667-bb3c-4b3e-9b79-bfb42140f0fb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:58.641663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 896/1810] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:58 2022] PUT /identity/v3/projects/c8eab79750bd48ea929899b175d67ad8/users/91899339931a4e609ceb438dd02238aa/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:18:58.654303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c849-17ec-4725-b8ac-e141aa413129 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:58.654587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c849-17ec-4725-b8ac-e141aa413129 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:58.654860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913c849-17ec-4725-b8ac-e141aa413129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:58.734823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0913c849-17ec-4725-b8ac-e141aa413129 None None] MFA Rules not processed for user `91899339931a4e609ceb438dd02238aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:58.742522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0913c849-17ec-4725-b8ac-e141aa413129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:58.915902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3667-bb3c-4b3e-9b79-bfb42140f0fb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:58.916905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 915/1811] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:18:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:18:58.975365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3a04-150b-40e2-8758-fc5e2b78b3ae None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:58.975746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3a04-150b-40e2-8758-fc5e2b78b3ae None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:58.976125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c3a04-150b-40e2-8758-fc5e2b78b3ae None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:58.978346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 916/1812] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:18:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:18:59.170949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe3667-bb3c-4b3e-9b79-bfb42140f0fb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:59.185156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:59.189035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:59.189576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:59.190680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:59.194053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:59.198945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:59.293818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c3a04-150b-40e2-8758-fc5e2b78b3ae None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:59.304548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 897/1813] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:18:58 2022] POST /identity/v3/projects => generated 385 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:59.426880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:59.429122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:59.545263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c3a04-150b-40e2-8758-fc5e2b78b3ae None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:59.556930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2280fdd-1819-4f4f-b429-de7449f3c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:59.557909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2280fdd-1819-4f4f-b429-de7449f3c188 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:59.559354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2280fdd-1819-4f4f-b429-de7449f3c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:59.559880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2280fdd-1819-4f4f-b429-de7449f3c188 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:59.561806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2280fdd-1819-4f4f-b429-de7449f3c188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:59.567451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2280fdd-1819-4f4f-b429-de7449f3c188 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:59.620929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 917/1814] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:18:59 2022] POST /identity/v3/users => generated 299 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:18:59.627094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2280fdd-1819-4f4f-b429-de7449f3c188 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:59.659371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f212ff2-d4bb-4a6e-86b0-5351244076b3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:59.661202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2280fdd-1819-4f4f-b429-de7449f3c188 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:59.671745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:59.673092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:59.673560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:59.673987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] PATH_INFO: `/v3/users/45b31534d7e447eca9c9105ac0ab84bc` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:59.675765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4bad4-4b08-4531-9094-cfccc3e2f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:59.676108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b31534d7e447eca9c9105ac0ab84bc)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:59.678715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4bad4-4b08-4531-9094-cfccc3e2f858 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:59.679299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4bad4-4b08-4531-9094-cfccc3e2f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:59.679674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4bad4-4b08-4531-9094-cfccc3e2f858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:59.681230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4bad4-4b08-4531-9094-cfccc3e2f858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:59.682376 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:59.685148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4bad4-4b08-4531-9094-cfccc3e2f858 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:59.718503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 918/1815] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:18:59.721943 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4bad4-4b08-4531-9094-cfccc3e2f858 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:59.758512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4bad4-4b08-4531-9094-cfccc3e2f858 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:18:59.758512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5696c-1ea4-4d97-8245-8132490740c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:18:59.758512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5696c-1ea4-4d97-8245-8132490740c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:59.758512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5696c-1ea4-4d97-8245-8132490740c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:59.758851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5696c-1ea4-4d97-8245-8132490740c5 admin admin] PATH_INFO: `/v3/projects/8b845b29ab0944b5be20aa400f33832e/users/37d36687ba22415e91b91f6868d87dd6/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:59.805391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5696c-1ea4-4d97-8245-8132490740c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b845b29ab0944b5be20aa400f33832e, user_id=37d36687ba22415e91b91f6868d87dd6, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:18:59.815118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b31534d7e447eca9c9105ac0ab84bc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:59.816210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5696c-1ea4-4d97-8245-8132490740c5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:18:59.834779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b31534d7e447eca9c9105ac0ab84bc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:59.837439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b31534d7e447eca9c9105ac0ab84bc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:59.839530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b31534d7e447eca9c9105ac0ab84bc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:59.860939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 919/1816] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:18:59 2022] PUT /identity/v3/projects/8b845b29ab0944b5be20aa400f33832e/users/37d36687ba22415e91b91f6868d87dd6/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:18:59.865205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55138f-0980-48b2-a78b-6ae1ecc88a5e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:18:59.865971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55138f-0980-48b2-a78b-6ae1ecc88a5e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:18:59.866239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55138f-0980-48b2-a78b-6ae1ecc88a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:18:59.871855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b31534d7e447eca9c9105ac0ab84bc'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:18:59.911466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:18:59.929447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-de55138f-0980-48b2-a78b-6ae1ecc88a5e None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:18:59.943902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-de55138f-0980-48b2-a78b-6ae1ecc88a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:18:59.964026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 898/1817] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:18:59 2022] DELETE /identity/v3/users/45b31534d7e447eca9c9105ac0ab84bc => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:18:59.965378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:18:59.970267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.055623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:00.177074 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 920/1818] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:00.180839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c41a5c-db90-46f0-8a71-95305b042db3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.182358 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c41a5c-db90-46f0-8a71-95305b042db3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.182649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c41a5c-db90-46f0-8a71-95305b042db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.227872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ecc99b-5b5d-4dd0-a292-fa6274688200 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:00.238234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d1c41a5c-db90-46f0-8a71-95305b042db3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:00.241446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:00.242139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.242438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.242707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.243809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:00.245231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d1c41a5c-db90-46f0-8a71-95305b042db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.247137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:00.274386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 921/1819] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:00.274608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 899/1820] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:00.278840 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c41a5c-db90-46f0-8a71-95305b042db3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:00.317080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:00.320026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.334354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c41a5c-db90-46f0-8a71-95305b042db3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:00.363082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:00.364016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.364437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.364722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] PATH_INFO: `/v3/projects/8b845b29ab0944b5be20aa400f33832e/users/37d36687ba22415e91b91f6868d87dd6/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.374380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b845b29ab0944b5be20aa400f33832e, user_id=37d36687ba22415e91b91f6868d87dd6, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:00.386759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:00.394611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea8701-22b8-4b07-92f4-2abcd09edc0e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:00.425845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ef3e1-e83d-489b-be75-0a94d8ff7d65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:00.427437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 922/1821] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:00 2022] PUT /identity/v3/projects/8b845b29ab0944b5be20aa400f33832e/users/37d36687ba22415e91b91f6868d87dd6/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:00.428700 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:00.439723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.446070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef3e1-e83d-489b-be75-0a94d8ff7d65 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.446070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef3e1-e83d-489b-be75-0a94d8ff7d65 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.446070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ef3e1-e83d-489b-be75-0a94d8ff7d65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.476529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ef3e1-e83d-489b-be75-0a94d8ff7d65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:00.480565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ef3e1-e83d-489b-be75-0a94d8ff7d65 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:00.512624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 900/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:00.515751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71482241-522e-47a9-ad3e-759d55cbd0e6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.517961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71482241-522e-47a9-ad3e-759d55cbd0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.518410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71482241-522e-47a9-ad3e-759d55cbd0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.583320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-71482241-522e-47a9-ad3e-759d55cbd0e6 None None] MFA Rules not processed for user `37d36687ba22415e91b91f6868d87dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:00.585277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-71482241-522e-47a9-ad3e-759d55cbd0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.632877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8149e2-72c5-43a7-923d-ceaa14e63ff7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:00.642280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:00.642921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.643256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.643540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.751995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 901/1823] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:00.755246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71482241-522e-47a9-ad3e-759d55cbd0e6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:00.759488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-71482241-522e-47a9-ad3e-759d55cbd0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.802942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:00.805174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:00.858648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 923/1824] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:00.861191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:00.867370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:00.965977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71482241-522e-47a9-ad3e-759d55cbd0e6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:00.983006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:00.984428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.984716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.985049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] PATH_INFO: `/v3/users/b51d31f51253453797955e7ff7714a0f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.986766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d1035-e694-4b28-a7a4-9bdba1172df1 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:00.989577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51d31f51253453797955e7ff7714a0f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:00.991847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b292d-a9eb-4b6b-9204-f364256e8811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:00.992606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b292d-a9eb-4b6b-9204-f364256e8811 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:00.994202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b292d-a9eb-4b6b-9204-f364256e8811 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:00.994202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b292d-a9eb-4b6b-9204-f364256e8811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:00.995344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:01.006252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b292d-a9eb-4b6b-9204-f364256e8811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:01.022240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303b292d-a9eb-4b6b-9204-f364256e8811 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:01.026565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:01.037456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 924/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:01.093310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b292d-a9eb-4b6b-9204-f364256e8811 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:01.101006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:01.118954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b292d-a9eb-4b6b-9204-f364256e8811 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:01.137640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:01.140417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:01.140826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:01.141251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] PATH_INFO: `/v3/users/91899339931a4e609ceb438dd02238aa` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:01.155154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91899339931a4e609ceb438dd02238aa)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:01.159658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:01.181299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51d31f51253453797955e7ff7714a0f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.206964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51d31f51253453797955e7ff7714a0f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.207666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51d31f51253453797955e7ff7714a0f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.208447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51d31f51253453797955e7ff7714a0f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.219048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9a32fee3-186a-45a1-a01c-12346789b41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51d31f51253453797955e7ff7714a0f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.270745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 902/1826] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:00 2022] DELETE /identity/v3/users/b51d31f51253453797955e7ff7714a0f => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:01.278728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04805a7-de42-4c2d-affb-e8e09fff921f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:01.279073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04805a7-de42-4c2d-affb-e8e09fff921f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:01.279308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04805a7-de42-4c2d-affb-e8e09fff921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:01.355906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91899339931a4e609ceb438dd02238aa'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.375343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91899339931a4e609ceb438dd02238aa'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.376842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91899339931a4e609ceb438dd02238aa'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.378417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91899339931a4e609ceb438dd02238aa'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.388585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e04805a7-de42-4c2d-affb-e8e09fff921f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:01.395194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e04805a7-de42-4c2d-affb-e8e09fff921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:01.408629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c076f615-a4c9-4aea-ab5d-c7d9a9add606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91899339931a4e609ceb438dd02238aa'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:01.473316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 925/1827] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:01 2022] DELETE /identity/v3/users/91899339931a4e609ceb438dd02238aa => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:01.482927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ee6fa-9dc2-4eb6-9f60-0466dd5b7161 None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:01.483682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ee6fa-9dc2-4eb6-9f60-0466dd5b7161 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:01.484195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ee6fa-9dc2-4eb6-9f60-0466dd5b7161 None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:01.492408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 926/1828] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:19:01 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:01.496905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ee6fa-9dc2-4eb6-9f60-0466dd5b7161 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:01.506206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d21ee6fa-9dc2-4eb6-9f60-0466dd5b7161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:01.640868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 903/1829] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:01.644251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12ac7-a3a3-47e7-8002-25d479514e8b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:01.645271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12ac7-a3a3-47e7-8002-25d479514e8b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:01.645579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa12ac7-a3a3-47e7-8002-25d479514e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:01.723936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8aa12ac7-a3a3-47e7-8002-25d479514e8b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:01.727947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8aa12ac7-a3a3-47e7-8002-25d479514e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:01.780531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ee6fa-9dc2-4eb6-9f60-0466dd5b7161 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:01.795269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:01.796533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:01.796951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:01.797339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] PATH_INFO: `/v3/projects/99af48fd3aae4f7bb17f16a1e633cfa0` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:01.802473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] RBAC: Authorizing `identity:delete_project(project_id=99af48fd3aae4f7bb17f16a1e633cfa0)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:01.805437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:01.869867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 904/1830] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:01.874952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23e43-7b14-4c89-a58c-219b5e0689ba None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:01.875298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23e43-7b14-4c89-a58c-219b5e0689ba None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:01.876106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23e43-7b14-4c89-a58c-219b5e0689ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:01.924776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0aa23e43-7b14-4c89-a58c-219b5e0689ba None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:01.926035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0aa23e43-7b14-4c89-a58c-219b5e0689ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:01.984819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:02.057341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99af48fd3aae4f7bb17f16a1e633cfa0', 'request_id': 'req-29b35c43-4050-4448-bdd5-c28a88567afc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.089528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99af48fd3aae4f7bb17f16a1e633cfa0', 'request_id': 'req-29b35c43-4050-4448-bdd5-c28a88567afc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.112418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99af48fd3aae4f7bb17f16a1e633cfa0', 'request_id': 'req-29b35c43-4050-4448-bdd5-c28a88567afc'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.135937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] The token cache is being invalidate because project 99af48fd3aae4f7bb17f16a1e633cfa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:02.136352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.137992 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.142727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 927/1831] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:01 2022] DELETE /identity/v3/projects/99af48fd3aae4f7bb17f16a1e633cfa0 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:02.143801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:02.145601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 905/1832] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:19:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:02.146396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:02.146530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23e43-7b14-4c89-a58c-219b5e0689ba None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:02.153631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0aa23e43-7b14-4c89-a58c-219b5e0689ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:02.162206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:02.298648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b35c43-4050-4448-bdd5-c28a88567afc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:02.306207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:02.324034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:02.324625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:02.327128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:02.332432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:02.336949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23e43-7b14-4c89-a58c-219b5e0689ba None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:02.347849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:02.348674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:02.349031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:02.349628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:02.355571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:02.551985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:02.553726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:02.568688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:02.573302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:02.580128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 928/1833] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:02.581228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:02.585153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:02.604009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 906/1834] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:02.621399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55cf77-e60e-4746-88fc-1835a1781ddd service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:02.631770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:02.632527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:02.632706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:02.633107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] PATH_INFO: `/v3/users/2218c972cb604fc7a59344ece17aaf59` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:02.638530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2218c972cb604fc7a59344ece17aaf59)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:02.640792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:02.763324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2218c972cb604fc7a59344ece17aaf59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.784034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2218c972cb604fc7a59344ece17aaf59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.784864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2218c972cb604fc7a59344ece17aaf59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.785524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2218c972cb604fc7a59344ece17aaf59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.819358 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2218c972cb604fc7a59344ece17aaf59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:02.862153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 929/1835] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:02 2022] DELETE /identity/v3/users/2218c972cb604fc7a59344ece17aaf59 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:02.935561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:02.937604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:02.988364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac285004-77ed-4ba4-8137-25e65768b539 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:03.029042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:03.030769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:03.145804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:03.206575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:03.207698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:03.210008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:03.210543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] PATH_INFO: `/v3/projects/599e81b9a2c444debd4750dfd17b15fa` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:03.215063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=599e81b9a2c444debd4750dfd17b15fa)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:03.218419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:03.237871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2831a-d4ec-4943-a02b-f8d2a5a8fb40 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:03.241150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:03.247459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:03.248382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:03.248668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:03.249114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:03.254249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:03.287529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:03.289905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:03.324958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 930/1836] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:03.336854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599e81b9a2c444debd4750dfd17b15fa', 'request_id': 'req-c82c7325-ab35-4106-955b-674b9aca9883'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.355494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599e81b9a2c444debd4750dfd17b15fa', 'request_id': 'req-c82c7325-ab35-4106-955b-674b9aca9883'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.377387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599e81b9a2c444debd4750dfd17b15fa', 'request_id': 'req-c82c7325-ab35-4106-955b-674b9aca9883'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.401360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] The token cache is being invalidate because project 599e81b9a2c444debd4750dfd17b15fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:03.401671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.404257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.410235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 907/1837] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:02 2022] DELETE /identity/v3/projects/599e81b9a2c444debd4750dfd17b15fa => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:03.410720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:03.412523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:03.470826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07db69-4edb-44bf-a7af-05820c985f6f service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:03.651246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:03.652139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:03.652523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:03.652909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] PATH_INFO: `/v3/users/f4c7df90ddca4d66a1bed4d9594b4b06` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:03.656761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c7df90ddca4d66a1bed4d9594b4b06)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:03.669181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:03.827537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c7df90ddca4d66a1bed4d9594b4b06'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.840637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c7df90ddca4d66a1bed4d9594b4b06'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.841797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c7df90ddca4d66a1bed4d9594b4b06'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.848256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c7df90ddca4d66a1bed4d9594b4b06'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.874229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c7df90ddca4d66a1bed4d9594b4b06'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:03.904164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 931/1838] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:03 2022] DELETE /identity/v3/users/f4c7df90ddca4d66a1bed4d9594b4b06 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:04.281136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:04.285843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:04.315076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7325-ab35-4106-955b-674b9aca9883 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:04.441797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:04.442657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:04.443475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:04.444001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] PATH_INFO: `/v3/projects/c8eab79750bd48ea929899b175d67ad8` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:04.445673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8eab79750bd48ea929899b175d67ad8)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:04.448322 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:04.526042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:04.529153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:04.566586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924cb5cd-361a-4afd-a7a4-c458978e024a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:04.567926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8eab79750bd48ea929899b175d67ad8', 'request_id': 'req-d68b0dc0-8914-4c13-9590-2680f52f20ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.579171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8eab79750bd48ea929899b175d67ad8', 'request_id': 'req-d68b0dc0-8914-4c13-9590-2680f52f20ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.598919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8eab79750bd48ea929899b175d67ad8', 'request_id': 'req-d68b0dc0-8914-4c13-9590-2680f52f20ad'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.616472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] The token cache is being invalidate because project c8eab79750bd48ea929899b175d67ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:04.616829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.617813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.619431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 908/1839] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:04 2022] DELETE /identity/v3/projects/c8eab79750bd48ea929899b175d67ad8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:04.623088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:04.624552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:04.656004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:04.710757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:04.741428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:04.748384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:04.748384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:04.748384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] PATH_INFO: `/v3/projects/f91ff4c7267545b4b0a3686c9727e27d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:04.748384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91ff4c7267545b4b0a3686c9727e27d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:04.748384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:04.866766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91ff4c7267545b4b0a3686c9727e27d', 'request_id': 'req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.874012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b0dc0-8914-4c13-9590-2680f52f20ad admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:04.878380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91ff4c7267545b4b0a3686c9727e27d', 'request_id': 'req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.895711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91ff4c7267545b4b0a3686c9727e27d', 'request_id': 'req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.919594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] The token cache is being invalidate because project f91ff4c7267545b4b0a3686c9727e27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:04.919886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.920653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-83a3e7c9-b954-4210-b1ae-639bf4d0faeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:04.923514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 932/1840] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:04 2022] DELETE /identity/v3/projects/f91ff4c7267545b4b0a3686c9727e27d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:04.928844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc496b-c72e-4254-b1a1-b4c5a01c213c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:04.929323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc496b-c72e-4254-b1a1-b4c5a01c213c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:04.929654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc496b-c72e-4254-b1a1-b4c5a01c213c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:04.995526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:04.996693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:04.997099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:04.997584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] PATH_INFO: `/v3/users/37d36687ba22415e91b91f6868d87dd6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:04.999483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d36687ba22415e91b91f6868d87dd6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:04.999960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-83fc496b-c72e-4254-b1a1-b4c5a01c213c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:05.001922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-83fc496b-c72e-4254-b1a1-b4c5a01c213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:05.002803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.035922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 933/1841] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:05.044066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb0376-7128-4d34-a425-ffb24735741b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.044417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb0376-7128-4d34-a425-ffb24735741b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.044757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb0376-7128-4d34-a425-ffb24735741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.087098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-98cb0376-7128-4d34-a425-ffb24735741b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:05.088303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-98cb0376-7128-4d34-a425-ffb24735741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:05.108537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 934/1842] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:05.115602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb0376-7128-4d34-a425-ffb24735741b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.120932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d36687ba22415e91b91f6868d87dd6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.138984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb0376-7128-4d34-a425-ffb24735741b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.145181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d36687ba22415e91b91f6868d87dd6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.145778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d36687ba22415e91b91f6868d87dd6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.146445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d36687ba22415e91b91f6868d87dd6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.160677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.161308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.161591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.161863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.162522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:05.162827 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.164473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.171642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d36687ba22415e91b91f6868d87dd6'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.194775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 935/1843] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:05.200636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.205126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:05.206672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 909/1844] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:04 2022] DELETE /identity/v3/users/37d36687ba22415e91b91f6868d87dd6 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:05.207792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.209938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:05.228746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a7777-5ab4-4f65-b8e6-f88ac8318582 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.294496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:05.316500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab9d02-b002-40c7-8ffe-9d9fec6ae673 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.329338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41b4de-3279-489f-97e9-84e43c5e9253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.330591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b4de-3279-489f-97e9-84e43c5e9253 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.331064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b4de-3279-489f-97e9-84e43c5e9253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.332103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.332908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.333300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.333764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] PATH_INFO: `/v3/projects/50bac462fda44022889e762a0d5e7f95` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.335680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50bac462fda44022889e762a0d5e7f95)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.337390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.351230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41b4de-3279-489f-97e9-84e43c5e9253 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.353522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b4de-3279-489f-97e9-84e43c5e9253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.355876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41b4de-3279-489f-97e9-84e43c5e9253 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.397515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:05.406535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 910/1845] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:05 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:05.411950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41b4de-3279-489f-97e9-84e43c5e9253 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.413551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50bac462fda44022889e762a0d5e7f95', 'request_id': 'req-6b2469e5-ae6e-453e-9899-74a1222f337c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.449413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50bac462fda44022889e762a0d5e7f95', 'request_id': 'req-6b2469e5-ae6e-453e-9899-74a1222f337c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.473623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50bac462fda44022889e762a0d5e7f95', 'request_id': 'req-6b2469e5-ae6e-453e-9899-74a1222f337c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.500546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] The token cache is being invalidate because project 50bac462fda44022889e762a0d5e7f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:05.504096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.505069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6b2469e5-ae6e-453e-9899-74a1222f337c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:05.514045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41b4de-3279-489f-97e9-84e43c5e9253 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.514564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 936/1846] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:05 2022] DELETE /identity/v3/projects/50bac462fda44022889e762a0d5e7f95 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:05.517276 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d944e-c18f-48f0-ad2c-f249528f5c26 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.518578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d944e-c18f-48f0-ad2c-f249528f5c26 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.521128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.521456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d944e-c18f-48f0-ad2c-f249528f5c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.521937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.522463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.522822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.523890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.526112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.570749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 911/1847] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:05 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:05.571100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-073d944e-c18f-48f0-ad2c-f249528f5c26 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:05.572284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.573362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-073d944e-c18f-48f0-ad2c-f249528f5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:05.574156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:05.591039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 937/1848] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:05.597179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d08f3-7d79-4f62-b906-52bb9d4d9fcd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.597465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d08f3-7d79-4f62-b906-52bb9d4d9fcd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.597740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d08f3-7d79-4f62-b906-52bb9d4d9fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.605204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759d473-1a92-420a-9f52-36a5aa8bedb4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.613939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e966cd-e9c3-43d7-8c68-d5abb931f614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.614716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e966cd-e9c3-43d7-8c68-d5abb931f614 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.615187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e966cd-e9c3-43d7-8c68-d5abb931f614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.615554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e966cd-e9c3-43d7-8c68-d5abb931f614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.616315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e966cd-e9c3-43d7-8c68-d5abb931f614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.618019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e966cd-e9c3-43d7-8c68-d5abb931f614 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.626219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-507d08f3-7d79-4f62-b906-52bb9d4d9fcd None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:05.627564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-507d08f3-7d79-4f62-b906-52bb9d4d9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:05.635760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 912/1849] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:05.638556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e966cd-e9c3-43d7-8c68-d5abb931f614 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.647250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 938/1850] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:05.649671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d08f3-7d79-4f62-b906-52bb9d4d9fcd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.659779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e966cd-e9c3-43d7-8c68-d5abb931f614 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.661607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d08f3-7d79-4f62-b906-52bb9d4d9fcd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.666668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.667210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6955144-e4f0-4c30-ac2e-d4ad64e951f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.667905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.668112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6955144-e4f0-4c30-ac2e-d4ad64e951f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.668478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.668624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6955144-e4f0-4c30-ac2e-d4ad64e951f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.668990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6955144-e4f0-4c30-ac2e-d4ad64e951f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.669645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.670419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6955144-e4f0-4c30-ac2e-d4ad64e951f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.670615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:05.671185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.673167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.675227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6955144-e4f0-4c30-ac2e-d4ad64e951f4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.694325 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 939/1851] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:05.695335 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.698532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 913/1852] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:05.705771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6955144-e4f0-4c30-ac2e-d4ad64e951f4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.708333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcb2ad-b796-47d3-a678-d225046b3e7a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.712857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4d1e6-8fff-47ff-91d7-686258eba963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.713469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d1e6-8fff-47ff-91d7-686258eba963 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.713747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d1e6-8fff-47ff-91d7-686258eba963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.714147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d1e6-8fff-47ff-91d7-686258eba963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.714883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4d1e6-8fff-47ff-91d7-686258eba963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.716898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4d1e6-8fff-47ff-91d7-686258eba963 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.718932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6955144-e4f0-4c30-ac2e-d4ad64e951f4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.727966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.729392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.729835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.730315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] PATH_INFO: `/v3/projects/b53f5eba54af4d58a357f0930248ce7a/users/ab094f75b6ec4bd088eaf2d916e943da/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.752252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53f5eba54af4d58a357f0930248ce7a, user_id=ab094f75b6ec4bd088eaf2d916e943da, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.755271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.764240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 940/1853] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:05 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:05.772233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4d1e6-8fff-47ff-91d7-686258eba963 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.795051 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 914/1854] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:05 2022] PUT /identity/v3/projects/b53f5eba54af4d58a357f0930248ce7a/users/ab094f75b6ec4bd088eaf2d916e943da/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:05.795051 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:05.800320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:05.885935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4d1e6-8fff-47ff-91d7-686258eba963 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.956525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e054ad-ebef-4ec1-acb1-ad9cbdc9daed admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:05.971078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.972100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.972397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.972667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] PATH_INFO: `/v3/projects/cd1faac81a534863b4eabead1277d1a8` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:05.973855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1faac81a534863b4eabead1277d1a8)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:05.976634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:05.998356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c7085-19fa-47fa-a288-4bba8a9daae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:05.999005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7085-19fa-47fa-a288-4bba8a9daae4 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:05.999301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7085-19fa-47fa-a288-4bba8a9daae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:05.999572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7085-19fa-47fa-a288-4bba8a9daae4 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.000981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c7085-19fa-47fa-a288-4bba8a9daae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.003413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c7085-19fa-47fa-a288-4bba8a9daae4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.013993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:06.040844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 941/1855] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:05 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:06.042241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4261-fce4-41cb-ab91-ea193d14546b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.042934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4261-fce4-41cb-ab91-ea193d14546b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.042934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4261-fce4-41cb-ab91-ea193d14546b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.059484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1faac81a534863b4eabead1277d1a8', 'request_id': 'req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.066930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1faac81a534863b4eabead1277d1a8', 'request_id': 'req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.088298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:06.091939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6a4c4261-fce4-41cb-ab91-ea193d14546b None None] MFA Rules not processed for user `ab094f75b6ec4bd088eaf2d916e943da`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:06.092118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1faac81a534863b4eabead1277d1a8', 'request_id': 'req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.094209 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6a4c4261-fce4-41cb-ab91-ea193d14546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.114869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] The token cache is being invalidate because project cd1faac81a534863b4eabead1277d1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:06.114869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.115448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.132356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 915/1856] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:05 2022] DELETE /identity/v3/projects/cd1faac81a534863b4eabead1277d1a8 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:06.137318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.144394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.191354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 942/1857] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:06.192562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c4261-fce4-41cb-ab91-ea193d14546b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.195627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6a4c4261-fce4-41cb-ab91-ea193d14546b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.242509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7b6bc-d2fe-4955-8443-e2d4b7ac4456 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.249101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.249744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.250117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.250587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] PATH_INFO: `/v3/projects/8b845b29ab0944b5be20aa400f33832e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.251843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b845b29ab0944b5be20aa400f33832e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.254196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.284662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c4261-fce4-41cb-ab91-ea193d14546b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.289654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626a574-71fe-4989-8f26-0b9023c2cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.290465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a574-71fe-4989-8f26-0b9023c2cb8e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.290744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a574-71fe-4989-8f26-0b9023c2cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.291047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626a574-71fe-4989-8f26-0b9023c2cb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.291693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a574-71fe-4989-8f26-0b9023c2cb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.293717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626a574-71fe-4989-8f26-0b9023c2cb8e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.310720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 943/1858] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:06.312094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6c0f-ed41-493f-a176-ee247c7d94fe None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.312221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b845b29ab0944b5be20aa400f33832e', 'request_id': 'req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.312714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6c0f-ed41-493f-a176-ee247c7d94fe None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.312854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6c0f-ed41-493f-a176-ee247c7d94fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.319045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b845b29ab0944b5be20aa400f33832e', 'request_id': 'req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.327074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b845b29ab0944b5be20aa400f33832e', 'request_id': 'req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.338806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-96ea6c0f-ed41-493f-a176-ee247c7d94fe None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:06.340150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] The token cache is being invalidate because project 8b845b29ab0944b5be20aa400f33832e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:06.340378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-96ea6c0f-ed41-493f-a176-ee247c7d94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.340499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.341257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:06.343307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 916/1859] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:06 2022] DELETE /identity/v3/projects/8b845b29ab0944b5be20aa400f33832e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:06.344867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.346243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.398845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:06.412803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 944/1860] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:06.413663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea6c0f-ed41-493f-a176-ee247c7d94fe None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.419870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-96ea6c0f-ed41-493f-a176-ee247c7d94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.424819 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6c2db-b348-4014-b2e7-0a4ddd0bd04b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.432552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea6c0f-ed41-493f-a176-ee247c7d94fe None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.439498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcfe8c-8880-49e6-93db-309b6966cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.439498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcfe8c-8880-49e6-93db-309b6966cc2f admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.439498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcfe8c-8880-49e6-93db-309b6966cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.439498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcfe8c-8880-49e6-93db-309b6966cc2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.439923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcfe8c-8880-49e6-93db-309b6966cc2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.440006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6fa8b-8c61-4590-8d78-a6588f0d3859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.440006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6fa8b-8c61-4590-8d78-a6588f0d3859 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.440006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6fa8b-8c61-4590-8d78-a6588f0d3859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.440006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6fa8b-8c61-4590-8d78-a6588f0d3859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.440342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcfe8c-8880-49e6-93db-309b6966cc2f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.440436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6fa8b-8c61-4590-8d78-a6588f0d3859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.440757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6fa8b-8c61-4590-8d78-a6588f0d3859 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.451694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 945/1861] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:06.453018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10cb9f-8b1a-4357-a83e-a41008955b67 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.453312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10cb9f-8b1a-4357-a83e-a41008955b67 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.453916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10cb9f-8b1a-4357-a83e-a41008955b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.473081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 917/1862] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:06.473081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65706917-a9db-4a7a-9725-392d3be56147 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.473081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65706917-a9db-4a7a-9725-392d3be56147 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.473081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65706917-a9db-4a7a-9725-392d3be56147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.474710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-cf10cb9f-8b1a-4357-a83e-a41008955b67 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:06.475996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cf10cb9f-8b1a-4357-a83e-a41008955b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.492623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-65706917-a9db-4a7a-9725-392d3be56147 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:06.493814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-65706917-a9db-4a7a-9725-392d3be56147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.502052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:06.546343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 946/1863] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:06.546343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10cb9f-8b1a-4357-a83e-a41008955b67 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.557713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10cb9f-8b1a-4357-a83e-a41008955b67 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.560397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 918/1864] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:06.561354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65706917-a9db-4a7a-9725-392d3be56147 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.565915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63809063-15c0-4fae-8b8f-c00b5742626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.566583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63809063-15c0-4fae-8b8f-c00b5742626b admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.566861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63809063-15c0-4fae-8b8f-c00b5742626b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.567204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63809063-15c0-4fae-8b8f-c00b5742626b admin admin] PATH_INFO: `/v3/projects/49c19621e71b4107a2a62ffde5bdabb6/users/bff40a77fa4544829136e7bf0bcd8c37/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.572365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65706917-a9db-4a7a-9725-392d3be56147 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.577100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6181-5dc5-4395-a1d5-3d33a3b7d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.577713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6181-5dc5-4395-a1d5-3d33a3b7d2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.577996 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6181-5dc5-4395-a1d5-3d33a3b7d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.578275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6181-5dc5-4395-a1d5-3d33a3b7d2b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.579498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c6181-5dc5-4395-a1d5-3d33a3b7d2b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.581403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c6181-5dc5-4395-a1d5-3d33a3b7d2b1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.583889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63809063-15c0-4fae-8b8f-c00b5742626b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c19621e71b4107a2a62ffde5bdabb6, user_id=bff40a77fa4544829136e7bf0bcd8c37, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.586505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63809063-15c0-4fae-8b8f-c00b5742626b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.603293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 947/1865] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:06 2022] PUT /identity/v3/projects/49c19621e71b4107a2a62ffde5bdabb6/users/bff40a77fa4544829136e7bf0bcd8c37/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:06.604964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b165a-db75-4f35-84aa-f5c6078c265d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.605249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b165a-db75-4f35-84aa-f5c6078c265d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.605523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b165a-db75-4f35-84aa-f5c6078c265d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.614658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 919/1866] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/users => generated 288 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:06.616924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6181-5dc5-4395-a1d5-3d33a3b7d2b1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.628438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6181-5dc5-4395-a1d5-3d33a3b7d2b1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.631037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ed1b165a-db75-4f35-84aa-f5c6078c265d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:06.632274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ed1b165a-db75-4f35-84aa-f5c6078c265d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.701244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.702109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.702600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.702954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.704683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:06.705068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.707335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.718786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 948/1867] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:06.723102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 920/1868] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:06.723102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.723343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29489f-9d33-4251-8a08-bab870dbe435 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.724070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29489f-9d33-4251-8a08-bab870dbe435 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.724352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29489f-9d33-4251-8a08-bab870dbe435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.732836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7c17-ec77-43d1-9416-997b1c7a5d95 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.738054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404022ed-e60d-4249-9829-2d2f6f673529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.738722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404022ed-e60d-4249-9829-2d2f6f673529 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.739159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404022ed-e60d-4249-9829-2d2f6f673529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.739456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404022ed-e60d-4249-9829-2d2f6f673529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.740083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404022ed-e60d-4249-9829-2d2f6f673529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.741665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404022ed-e60d-4249-9829-2d2f6f673529 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.752663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 921/1869] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:06.753004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6a29489f-9d33-4251-8a08-bab870dbe435 None None] MFA Rules not processed for user `bff40a77fa4544829136e7bf0bcd8c37`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:06.753313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404022ed-e60d-4249-9829-2d2f6f673529 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.754214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6a29489f-9d33-4251-8a08-bab870dbe435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.763301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404022ed-e60d-4249-9829-2d2f6f673529 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.768468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.769071 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.769356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.769629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.770278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:06.770598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.772235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.784655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 922/1870] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:06.785445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.797862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c6a5-a250-499d-9f32-778e8921f4de admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.803040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd879cd-63ef-4213-b29e-bb9c2cf2de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.803634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd879cd-63ef-4213-b29e-bb9c2cf2de8e admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.803918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd879cd-63ef-4213-b29e-bb9c2cf2de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.804197 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd879cd-63ef-4213-b29e-bb9c2cf2de8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.804827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd879cd-63ef-4213-b29e-bb9c2cf2de8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.806851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd879cd-63ef-4213-b29e-bb9c2cf2de8e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.822685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 949/1871] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:06.824409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29489f-9d33-4251-8a08-bab870dbe435 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.832576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:06.840020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29489f-9d33-4251-8a08-bab870dbe435 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.843222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 923/1872] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:06.844553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd879cd-63ef-4213-b29e-bb9c2cf2de8e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.878800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:06.903849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.904565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.904902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.905182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.905825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.908028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.911404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd879cd-63ef-4213-b29e-bb9c2cf2de8e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:06.916076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca7cc-be7b-4023-9fbf-1d946eb9775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:06.916683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca7cc-be7b-4023-9fbf-1d946eb9775c admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:06.916967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca7cc-be7b-4023-9fbf-1d946eb9775c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:06.917244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca7cc-be7b-4023-9fbf-1d946eb9775c admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:06.917882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ca7cc-be7b-4023-9fbf-1d946eb9775c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:06.918169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 950/1873] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:06.918971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:06.919900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ca7cc-be7b-4023-9fbf-1d946eb9775c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:06.920720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:06.948778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 924/1874] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:06.949759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca7cc-be7b-4023-9fbf-1d946eb9775c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.006963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db6950-74b5-4390-8b58-92ae39462e0f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.029295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca7cc-be7b-4023-9fbf-1d946eb9775c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.038117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6c60-6217-4275-9914-09b2fd506644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.039013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6c60-6217-4275-9914-09b2fd506644 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.039456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6c60-6217-4275-9914-09b2fd506644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.039896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6c60-6217-4275-9914-09b2fd506644 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.041336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b6c60-6217-4275-9914-09b2fd506644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.045585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b6c60-6217-4275-9914-09b2fd506644 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.073447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce610368-d76c-4115-b10e-2b7f8eda5641 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a909fc6177e94d2fa6d38dad285e616a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.074131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610368-d76c-4115-b10e-2b7f8eda5641 service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.074541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610368-d76c-4115-b10e-2b7f8eda5641 service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.075804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610368-d76c-4115-b10e-2b7f8eda5641 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.085163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 925/1875] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:06 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:07.087366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6c60-6217-4275-9914-09b2fd506644 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.103187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6c60-6217-4275-9914-09b2fd506644 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.110861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0466ca-40f7-4a25-8aba-ed8fdb0fed0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.111824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0466ca-40f7-4a25-8aba-ed8fdb0fed0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.112644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0466ca-40f7-4a25-8aba-ed8fdb0fed0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.112936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0466ca-40f7-4a25-8aba-ed8fdb0fed0e admin admin] PATH_INFO: `/v3/projects/ed33499e085b4d2cb8c24e60d90769ce/users/03fd409e726748ac80285295b451a347/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.139026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0466ca-40f7-4a25-8aba-ed8fdb0fed0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed33499e085b4d2cb8c24e60d90769ce, user_id=03fd409e726748ac80285295b451a347, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.142211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0466ca-40f7-4a25-8aba-ed8fdb0fed0e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.167040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 926/1876] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:07 2022] PUT /identity/v3/projects/ed33499e085b4d2cb8c24e60d90769ce/users/03fd409e726748ac80285295b451a347/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:07.168323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0466ca-40f7-4a25-8aba-ed8fdb0fed0e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.198247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce610368-d76c-4115-b10e-2b7f8eda5641 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.204740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce610368-d76c-4115-b10e-2b7f8eda5641 service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.226668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 951/1877] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:07.228214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce610368-d76c-4115-b10e-2b7f8eda5641 service glance] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.247595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce610368-d76c-4115-b10e-2b7f8eda5641 service glance] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.284065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:07.322602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:07.349337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640c431-c0f3-4d0b-8d39-e7de0452a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.350105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640c431-c0f3-4d0b-8d39-e7de0452a3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.350393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640c431-c0f3-4d0b-8d39-e7de0452a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.350671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640c431-c0f3-4d0b-8d39-e7de0452a3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.351417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640c431-c0f3-4d0b-8d39-e7de0452a3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.352460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0466ca-40f7-4a25-8aba-ed8fdb0fed0e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.353041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640c431-c0f3-4d0b-8d39-e7de0452a3c8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.358875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08e959-d2a3-4d0f-bd34-da41009f8e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.360185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08e959-d2a3-4d0f-bd34-da41009f8e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.360518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08e959-d2a3-4d0f-bd34-da41009f8e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.360831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08e959-d2a3-4d0f-bd34-da41009f8e5e admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.361907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08e959-d2a3-4d0f-bd34-da41009f8e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.367760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 952/1878] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:07.369156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42892bc3-a247-46ec-a7fa-b8c8f30fc661 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.369980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42892bc3-a247-46ec-a7fa-b8c8f30fc661 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.370523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42892bc3-a247-46ec-a7fa-b8c8f30fc661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.372284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08e959-d2a3-4d0f-bd34-da41009f8e5e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.430295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 927/1879] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:07 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:07.432302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08e959-d2a3-4d0f-bd34-da41009f8e5e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.499734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-42892bc3-a247-46ec-a7fa-b8c8f30fc661 None None] MFA Rules not processed for user `03fd409e726748ac80285295b451a347`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:07.501001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-42892bc3-a247-46ec-a7fa-b8c8f30fc661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:07.501353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08e959-d2a3-4d0f-bd34-da41009f8e5e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.513519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85bb5b-e795-455b-8137-917dc77b1761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.513765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85bb5b-e795-455b-8137-917dc77b1761 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.514083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85bb5b-e795-455b-8137-917dc77b1761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.514317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85bb5b-e795-455b-8137-917dc77b1761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.514968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85bb5b-e795-455b-8137-917dc77b1761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.517501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85bb5b-e795-455b-8137-917dc77b1761 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.566791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 928/1880] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:07.568950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85bb5b-e795-455b-8137-917dc77b1761 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.593678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85bb5b-e795-455b-8137-917dc77b1761 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.611356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fdcd-e073-415b-a278-ae65c9318b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.612501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fdcd-e073-415b-a278-ae65c9318b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.612790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fdcd-e073-415b-a278-ae65c9318b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.613070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fdcd-e073-415b-a278-ae65c9318b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.613725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8fdcd-e073-415b-a278-ae65c9318b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.615606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8fdcd-e073-415b-a278-ae65c9318b65 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.631208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 929/1881] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:07.632186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fdcd-e073-415b-a278-ae65c9318b65 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.644719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fdcd-e073-415b-a278-ae65c9318b65 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.650934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 953/1882] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:07.652375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42892bc3-a247-46ec-a7fa-b8c8f30fc661 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.667722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9892f4-52b0-47b9-aeac-2dd48d16303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.668468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9892f4-52b0-47b9-aeac-2dd48d16303c admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.668757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9892f4-52b0-47b9-aeac-2dd48d16303c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.669043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9892f4-52b0-47b9-aeac-2dd48d16303c admin admin] PATH_INFO: `/v3/projects/bbb290f5b71b452e8efd2ae4e730423c/users/28f840eb92834e7eb976778886267012/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.681876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42892bc3-a247-46ec-a7fa-b8c8f30fc661 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.690914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9892f4-52b0-47b9-aeac-2dd48d16303c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb290f5b71b452e8efd2ae4e730423c, user_id=28f840eb92834e7eb976778886267012, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.691315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dd75-3233-4c54-9083-50a4c6260e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.692124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dd75-3233-4c54-9083-50a4c6260e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.692554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dd75-3233-4c54-9083-50a4c6260e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.692968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5dd75-3233-4c54-9083-50a4c6260e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.693781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5dd75-3233-4c54-9083-50a4c6260e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.695560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5dd75-3233-4c54-9083-50a4c6260e6b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.696312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9892f4-52b0-47b9-aeac-2dd48d16303c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.712935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 930/1883] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:07 2022] PUT /identity/v3/projects/bbb290f5b71b452e8efd2ae4e730423c/users/28f840eb92834e7eb976778886267012/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:07.714049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9892f4-52b0-47b9-aeac-2dd48d16303c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.717328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 954/1884] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:07.718240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dd75-3233-4c54-9083-50a4c6260e6b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.733695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5dd75-3233-4c54-9083-50a4c6260e6b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.811591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9892f4-52b0-47b9-aeac-2dd48d16303c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:07.820712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c618a7-1816-450a-8f7b-4cfaabde3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.823421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c618a7-1816-450a-8f7b-4cfaabde3543 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.823967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c618a7-1816-450a-8f7b-4cfaabde3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.824532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c618a7-1816-450a-8f7b-4cfaabde3543 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.825645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c618a7-1816-450a-8f7b-4cfaabde3543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.828448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c618a7-1816-450a-8f7b-4cfaabde3543 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.848121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d135-2274-4f04-88a4-84c76372b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:07.848940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d135-2274-4f04-88a4-84c76372b86f admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.849229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d135-2274-4f04-88a4-84c76372b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.849506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272d135-2274-4f04-88a4-84c76372b86f admin admin] PATH_INFO: `/v3/projects/4d60bbc4dfec4c67a88ffe01af904542/users/ff9d0ff3dbf94c099565647c73d66dab/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.876797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d135-2274-4f04-88a4-84c76372b86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d60bbc4dfec4c67a88ffe01af904542, user_id=ff9d0ff3dbf94c099565647c73d66dab, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:07.877943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 931/1885] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:07 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:07.879963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468da48-7796-41ef-958e-3e8325fdb939 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:07.880402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468da48-7796-41ef-958e-3e8325fdb939 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:07.881042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468da48-7796-41ef-958e-3e8325fdb939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:07.881601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272d135-2274-4f04-88a4-84c76372b86f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:07.900572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 955/1886] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:07 2022] PUT /identity/v3/projects/4d60bbc4dfec4c67a88ffe01af904542/users/ff9d0ff3dbf94c099565647c73d66dab/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:07.901715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d135-2274-4f04-88a4-84c76372b86f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:07.912881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c468da48-7796-41ef-958e-3e8325fdb939 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:07.914144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c468da48-7796-41ef-958e-3e8325fdb939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:08.010597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:08.033155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 932/1887] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:08.033155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deddfc-73c0-44eb-b515-5ffbda151bb3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.033155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deddfc-73c0-44eb-b515-5ffbda151bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.033155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65deddfc-73c0-44eb-b515-5ffbda151bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.093156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-65deddfc-73c0-44eb-b515-5ffbda151bb3 None None] MFA Rules not processed for user `ff9d0ff3dbf94c099565647c73d66dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:08.095357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-65deddfc-73c0-44eb-b515-5ffbda151bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:08.101315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:08.104345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272d135-2274-4f04-88a4-84c76372b86f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.109473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.110400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.110933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.111698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.112129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.114583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.147437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 956/1888] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:07 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:08.147437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.147437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:08.208474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 933/1889] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:08.212641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deddfc-73c0-44eb-b515-5ffbda151bb3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.227256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65deddfc-73c0-44eb-b515-5ffbda151bb3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.230909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008e885-c113-406d-a2cb-6a5d96f62eb4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.232057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7aa7-7df3-4297-88e7-b7414ddc35a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.232743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7aa7-7df3-4297-88e7-b7414ddc35a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.233033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7aa7-7df3-4297-88e7-b7414ddc35a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.233315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7aa7-7df3-4297-88e7-b7414ddc35a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.233973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7aa7-7df3-4297-88e7-b7414ddc35a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.234653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039abf-1ee2-4a78-93c8-ba623bf814c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.235587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039abf-1ee2-4a78-93c8-ba623bf814c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.235922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b7aa7-7df3-4297-88e7-b7414ddc35a7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.236026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039abf-1ee2-4a78-93c8-ba623bf814c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.236255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc039abf-1ee2-4a78-93c8-ba623bf814c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.247875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc039abf-1ee2-4a78-93c8-ba623bf814c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.249703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc039abf-1ee2-4a78-93c8-ba623bf814c7 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.251012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 934/1890] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:08.251936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7aa7-7df3-4297-88e7-b7414ddc35a7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.262489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 957/1891] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:08.262706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7aa7-7df3-4297-88e7-b7414ddc35a7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.263369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039abf-1ee2-4a78-93c8-ba623bf814c7 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.268663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd358c37-d66f-4b62-b1f7-547933a28af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.269378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd358c37-d66f-4b62-b1f7-547933a28af2 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.269738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd358c37-d66f-4b62-b1f7-547933a28af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.270091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd358c37-d66f-4b62-b1f7-547933a28af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.270927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd358c37-d66f-4b62-b1f7-547933a28af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.273079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd358c37-d66f-4b62-b1f7-547933a28af2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.275696 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc039abf-1ee2-4a78-93c8-ba623bf814c7 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.285321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469935e-3aba-48d6-966c-a07807a61456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.286507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469935e-3aba-48d6-966c-a07807a61456 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.286793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469935e-3aba-48d6-966c-a07807a61456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.288121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469935e-3aba-48d6-966c-a07807a61456 admin admin] PATH_INFO: `/v3/projects/2696695f7b194e61ad02ad344fd8e61c/users/fbef193c94ad496a8424889614f8523f/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.314877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 935/1892] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:08 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:08.315815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469935e-3aba-48d6-966c-a07807a61456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2696695f7b194e61ad02ad344fd8e61c, user_id=fbef193c94ad496a8424889614f8523f, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.318912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469935e-3aba-48d6-966c-a07807a61456 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.324678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd358c37-d66f-4b62-b1f7-547933a28af2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.338813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 958/1893] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:08 2022] PUT /identity/v3/projects/2696695f7b194e61ad02ad344fd8e61c/users/fbef193c94ad496a8424889614f8523f/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:08.343986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469935e-3aba-48d6-966c-a07807a61456 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.413172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd358c37-d66f-4b62-b1f7-547933a28af2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.438795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469935e-3aba-48d6-966c-a07807a61456 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.447257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220519a-b788-4bae-907a-22d4a1b99960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.448632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220519a-b788-4bae-907a-22d4a1b99960 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.449082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220519a-b788-4bae-907a-22d4a1b99960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.449895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220519a-b788-4bae-907a-22d4a1b99960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.450888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220519a-b788-4bae-907a-22d4a1b99960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.454556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220519a-b788-4bae-907a-22d4a1b99960 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.499045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 959/1894] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:08.504817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220519a-b788-4bae-907a-22d4a1b99960 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.535109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220519a-b788-4bae-907a-22d4a1b99960 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.545116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06120d58-1817-48e3-9802-6a45a7092a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.547294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06120d58-1817-48e3-9802-6a45a7092a45 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.547294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06120d58-1817-48e3-9802-6a45a7092a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.548940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06120d58-1817-48e3-9802-6a45a7092a45 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.549825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06120d58-1817-48e3-9802-6a45a7092a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.551884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d969ccc-88d9-44ac-810e-d3fd9c656a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.552352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969ccc-88d9-44ac-810e-d3fd9c656a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.552691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969ccc-88d9-44ac-810e-d3fd9c656a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.552976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969ccc-88d9-44ac-810e-d3fd9c656a82 admin admin] PATH_INFO: `/v3/projects/2696695f7b194e61ad02ad344fd8e61c/users/fbef193c94ad496a8424889614f8523f/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.554750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06120d58-1817-48e3-9802-6a45a7092a45 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.568406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d969ccc-88d9-44ac-810e-d3fd9c656a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2696695f7b194e61ad02ad344fd8e61c, user_id=fbef193c94ad496a8424889614f8523f, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.580801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d969ccc-88d9-44ac-810e-d3fd9c656a82 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.597316 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 936/1895] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:08 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:08.598563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06120d58-1817-48e3-9802-6a45a7092a45 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.610194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06120d58-1817-48e3-9802-6a45a7092a45 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.614598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 960/1896] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:08 2022] PUT /identity/v3/projects/2696695f7b194e61ad02ad344fd8e61c/users/fbef193c94ad496a8424889614f8523f/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:08.622277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:08.629583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a7b5d-2c88-4d17-89a9-83f84e61ff82 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.629977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a7b5d-2c88-4d17-89a9-83f84e61ff82 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.630333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a7b5d-2c88-4d17-89a9-83f84e61ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.656395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:08.677530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-515a7b5d-2c88-4d17-89a9-83f84e61ff82 None None] MFA Rules not processed for user `fbef193c94ad496a8424889614f8523f`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:08.679043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-515a7b5d-2c88-4d17-89a9-83f84e61ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:08.719489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f056f-046e-4cb0-98b0-78bd2941d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.721343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f056f-046e-4cb0-98b0-78bd2941d917 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.721986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f056f-046e-4cb0-98b0-78bd2941d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.722381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f056f-046e-4cb0-98b0-78bd2941d917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.723491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f056f-046e-4cb0-98b0-78bd2941d917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.727638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f056f-046e-4cb0-98b0-78bd2941d917 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.745047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 937/1897] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:08.748357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f056f-046e-4cb0-98b0-78bd2941d917 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.763128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f056f-046e-4cb0-98b0-78bd2941d917 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.768398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e66828-6fcb-4773-b485-80cd4f230813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.769855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e66828-6fcb-4773-b485-80cd4f230813 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.770222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e66828-6fcb-4773-b485-80cd4f230813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.770501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e66828-6fcb-4773-b485-80cd4f230813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.771232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e66828-6fcb-4773-b485-80cd4f230813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.773753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e66828-6fcb-4773-b485-80cd4f230813 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.782405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 961/1898] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:08.799857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a7b5d-2c88-4d17-89a9-83f84e61ff82 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.801414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-515a7b5d-2c88-4d17-89a9-83f84e61ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:08.804100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 938/1899] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:08.809158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e66828-6fcb-4773-b485-80cd4f230813 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:08.829165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e66828-6fcb-4773-b485-80cd4f230813 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.859383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816a35a-b8f5-4a61-be7b-afacf530ef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:08.860894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a35a-b8f5-4a61-be7b-afacf530ef8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.862274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a35a-b8f5-4a61-be7b-afacf530ef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.862561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816a35a-b8f5-4a61-be7b-afacf530ef8f admin admin] PATH_INFO: `/v3/projects/ec89152b16ec48fba3133e3bdd9418dc/users/7a9c2642ec8a4f00b4462da4905f7cb3/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:08.893369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a35a-b8f5-4a61-be7b-afacf530ef8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec89152b16ec48fba3133e3bdd9418dc, user_id=7a9c2642ec8a4f00b4462da4905f7cb3, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:08.900806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816a35a-b8f5-4a61-be7b-afacf530ef8f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:08.937668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a7b5d-2c88-4d17-89a9-83f84e61ff82 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:08.949814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 939/1900] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:08 2022] PUT /identity/v3/projects/ec89152b16ec48fba3133e3bdd9418dc/users/7a9c2642ec8a4f00b4462da4905f7cb3/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:08.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b0a5-3db5-47d0-bf61-eeb2c21899ce None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:08.965773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b0a5-3db5-47d0-bf61-eeb2c21899ce None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:08.966117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270b0a5-3db5-47d0-bf61-eeb2c21899ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.010027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.010777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.011560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.011854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.027906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:09.028143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2270b0a5-3db5-47d0-bf61-eeb2c21899ce None None] MFA Rules not processed for user `7a9c2642ec8a4f00b4462da4905f7cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:09.029226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2270b0a5-3db5-47d0-bf61-eeb2c21899ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:09.174155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.176157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.180836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 940/1901] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:09.184947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b0a5-3db5-47d0-bf61-eeb2c21899ce None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.187270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 962/1902] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:09.256510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270b0a5-3db5-47d0-bf61-eeb2c21899ce None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.261973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a34e92-1b70-4785-b6b5-c6eb5c9cc7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.262887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a34e92-1b70-4785-b6b5-c6eb5c9cc7ae admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.263463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a34e92-1b70-4785-b6b5-c6eb5c9cc7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.263885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a34e92-1b70-4785-b6b5-c6eb5c9cc7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.264812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a34e92-1b70-4785-b6b5-c6eb5c9cc7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.267370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a34e92-1b70-4785-b6b5-c6eb5c9cc7ae admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.279709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:09.310258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 941/1903] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:09 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:09.314591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.326136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd2204-9658-4194-b7ff-746585ae20fa service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.330762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:09.412083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ccecd-f3eb-4758-af62-62423851db3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.412800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ccecd-f3eb-4758-af62-62423851db3b admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.413305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ccecd-f3eb-4758-af62-62423851db3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.413682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ccecd-f3eb-4758-af62-62423851db3b admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.414565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ccecd-f3eb-4758-af62-62423851db3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.417176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ccecd-f3eb-4758-af62-62423851db3b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.451363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 963/1904] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:09 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:09.454778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a34e92-1b70-4785-b6b5-c6eb5c9cc7ae admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.471886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a34e92-1b70-4785-b6b5-c6eb5c9cc7ae admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.501662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1661580-5dee-4a8d-8142-e891ba48b968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.502712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661580-5dee-4a8d-8142-e891ba48b968 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.503054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661580-5dee-4a8d-8142-e891ba48b968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.503454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661580-5dee-4a8d-8142-e891ba48b968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.504270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1661580-5dee-4a8d-8142-e891ba48b968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.505847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1661580-5dee-4a8d-8142-e891ba48b968 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.509813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb628-24db-467b-94f0-428364defb29 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.510271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb628-24db-467b-94f0-428364defb29 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.510788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45eb628-24db-467b-94f0-428364defb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.516648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 942/1905] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:09.520707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1661580-5dee-4a8d-8142-e891ba48b968 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.531901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1661580-5dee-4a8d-8142-e891ba48b968 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.552682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa73e-8296-4ccb-9bad-bcf704e6f4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.553942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa73e-8296-4ccb-9bad-bcf704e6f4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.554391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa73e-8296-4ccb-9bad-bcf704e6f4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.554892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fa73e-8296-4ccb-9bad-bcf704e6f4ef admin admin] PATH_INFO: `/v3/projects/378bd1fd80c6423f9febb5e6e76dc2c3/users/35344278b04d49709ea57a0b5cb1495e/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.571803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fa73e-8296-4ccb-9bad-bcf704e6f4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=378bd1fd80c6423f9febb5e6e76dc2c3, user_id=35344278b04d49709ea57a0b5cb1495e, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.574530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fa73e-8296-4ccb-9bad-bcf704e6f4ef admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.574750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a45eb628-24db-467b-94f0-428364defb29 None None] MFA Rules not processed for user `28f840eb92834e7eb976778886267012`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:09.576189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a45eb628-24db-467b-94f0-428364defb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:09.591861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 943/1906] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:09 2022] PUT /identity/v3/projects/378bd1fd80c6423f9febb5e6e76dc2c3/users/35344278b04d49709ea57a0b5cb1495e/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:09.595972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa73e-8296-4ccb-9bad-bcf704e6f4ef admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.700092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fa73e-8296-4ccb-9bad-bcf704e6f4ef admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.703326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 964/1907] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:09.707640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eb628-24db-467b-94f0-428364defb29 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.709547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76c27-8477-4a21-a28d-7d80958be883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.710262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76c27-8477-4a21-a28d-7d80958be883 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.710616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76c27-8477-4a21-a28d-7d80958be883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.710956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e76c27-8477-4a21-a28d-7d80958be883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.711740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e76c27-8477-4a21-a28d-7d80958be883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.713758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e76c27-8477-4a21-a28d-7d80958be883 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.719791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45eb628-24db-467b-94f0-428364defb29 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.725353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840b2c3-e8a1-4f99-8129-7aa582bcf93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.726051 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840b2c3-e8a1-4f99-8129-7aa582bcf93c admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.726407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840b2c3-e8a1-4f99-8129-7aa582bcf93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.726753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840b2c3-e8a1-4f99-8129-7aa582bcf93c admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.727167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 944/1908] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:09.727547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840b2c3-e8a1-4f99-8129-7aa582bcf93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.729519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840b2c3-e8a1-4f99-8129-7aa582bcf93c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.730794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76c27-8477-4a21-a28d-7d80958be883 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.744449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e76c27-8477-4a21-a28d-7d80958be883 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.749678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d81cd7-8274-408f-a0cb-84ca24b07fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.751572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81cd7-8274-408f-a0cb-84ca24b07fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.751941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81cd7-8274-408f-a0cb-84ca24b07fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.752189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d81cd7-8274-408f-a0cb-84ca24b07fb4 admin admin] PATH_INFO: `/v3/projects/378bd1fd80c6423f9febb5e6e76dc2c3/users/35344278b04d49709ea57a0b5cb1495e/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.754353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d81cd7-8274-408f-a0cb-84ca24b07fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378bd1fd80c6423f9febb5e6e76dc2c3, user_id=35344278b04d49709ea57a0b5cb1495e, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.757154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d81cd7-8274-408f-a0cb-84ca24b07fb4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.762662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 965/1909] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:09 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:09.767129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840b2c3-e8a1-4f99-8129-7aa582bcf93c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.769905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 945/1910] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:09 2022] PUT /identity/v3/projects/378bd1fd80c6423f9febb5e6e76dc2c3/users/35344278b04d49709ea57a0b5cb1495e/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:09.783034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78cea-43ec-44b1-b166-a59b2dcfb4e8 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.783458 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78cea-43ec-44b1-b166-a59b2dcfb4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.783810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd78cea-43ec-44b1-b166-a59b2dcfb4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.816750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cdd78cea-43ec-44b1-b166-a59b2dcfb4e8 None None] MFA Rules not processed for user `35344278b04d49709ea57a0b5cb1495e`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:09.818063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cdd78cea-43ec-44b1-b166-a59b2dcfb4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:09.831118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840b2c3-e8a1-4f99-8129-7aa582bcf93c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.839144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:09.905489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0b58-ffd9-4833-b632-034fcea8f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.906101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0b58-ffd9-4833-b632-034fcea8f2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.906934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0b58-ffd9-4833-b632-034fcea8f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.907772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0b58-ffd9-4833-b632-034fcea8f2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.908094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0b58-ffd9-4833-b632-034fcea8f2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.912901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0b58-ffd9-4833-b632-034fcea8f2b8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.913043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 946/1911] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:09.921229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd78cea-43ec-44b1-b166-a59b2dcfb4e8 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.935110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 966/1912] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:09 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:09.939772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0b58-ffd9-4833-b632-034fcea8f2b8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.949050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:09.952583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0b58-ffd9-4833-b632-034fcea8f2b8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:09.959698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64226-509e-4d88-9949-231f45481d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:09.960432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64226-509e-4d88-9949-231f45481d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:09.960844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64226-509e-4d88-9949-231f45481d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:09.961139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64226-509e-4d88-9949-231f45481d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:09.961864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64226-509e-4d88-9949-231f45481d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:09.963578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64226-509e-4d88-9949-231f45481d9e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:09.980931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 967/1913] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:09.986391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64226-509e-4d88-9949-231f45481d9e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:09.999987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64226-509e-4d88-9949-231f45481d9e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:10.007262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d52cb-554d-4ef3-b4d2-547c44952219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:10.008451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d52cb-554d-4ef3-b4d2-547c44952219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:10.008872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd78cea-43ec-44b1-b166-a59b2dcfb4e8 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:10.009131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d52cb-554d-4ef3-b4d2-547c44952219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:10.009587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d52cb-554d-4ef3-b4d2-547c44952219 admin admin] PATH_INFO: `/v3/projects/6991df538a574a43b60bd77ae9db0432/users/02f9f388c16748c086f09f20e4853d47/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:10.013220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cf7e6-54cd-4eff-ac74-9e519dd4f2ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:10.014826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf7e6-54cd-4eff-ac74-9e519dd4f2ab service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:10.015166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf7e6-54cd-4eff-ac74-9e519dd4f2ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:10.015449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cf7e6-54cd-4eff-ac74-9e519dd4f2ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:10.026890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cf7e6-54cd-4eff-ac74-9e519dd4f2ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:10.028512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cf7e6-54cd-4eff-ac74-9e519dd4f2ab service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:10.029636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d52cb-554d-4ef3-b4d2-547c44952219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6991df538a574a43b60bd77ae9db0432, user_id=02f9f388c16748c086f09f20e4853d47, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:10.033028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d52cb-554d-4ef3-b4d2-547c44952219 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:10.040315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 947/1914] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:10.058833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 968/1915] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:09 2022] PUT /identity/v3/projects/6991df538a574a43b60bd77ae9db0432/users/02f9f388c16748c086f09f20e4853d47/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:10.062560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cf7e6-54cd-4eff-ac74-9e519dd4f2ab service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:10.074775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cf7e6-54cd-4eff-ac74-9e519dd4f2ab service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:10.163657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af925a6c-2ea6-4840-8484-8e29921e90e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:10.166472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af925a6c-2ea6-4840-8484-8e29921e90e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:10.168036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af925a6c-2ea6-4840-8484-8e29921e90e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:10.168328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af925a6c-2ea6-4840-8484-8e29921e90e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:10.169009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af925a6c-2ea6-4840-8484-8e29921e90e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:10.170727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af925a6c-2ea6-4840-8484-8e29921e90e8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:10.186111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 948/1916] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:10.189968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d52cb-554d-4ef3-b4d2-547c44952219 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:10.205748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d52cb-554d-4ef3-b4d2-547c44952219 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:10.218655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:10.220076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:10.220440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:10.220793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] PATH_INFO: `/v3/projects/6991df538a574a43b60bd77ae9db0432/users/02f9f388c16748c086f09f20e4853d47/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:10.226878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6991df538a574a43b60bd77ae9db0432, user_id=02f9f388c16748c086f09f20e4853d47, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:10.229869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:10.250867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 969/1917] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:10 2022] PUT /identity/v3/projects/6991df538a574a43b60bd77ae9db0432/users/02f9f388c16748c086f09f20e4853d47/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:10.816201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af925a6c-2ea6-4840-8484-8e29921e90e8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:10.904965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af925a6c-2ea6-4840-8484-8e29921e90e8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:10.959825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:10.962311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:10.980054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b3cab0-1f82-4c72-9508-f239d33c5ea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:10.980687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3cab0-1f82-4c72-9508-f239d33c5ea7 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:10.981029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3cab0-1f82-4c72-9508-f239d33c5ea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:10.981305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3cab0-1f82-4c72-9508-f239d33c5ea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:11.036979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:11.076717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ab4f4-c810-46dd-b354-674e21f3c51c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:11.080899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3cab0-1f82-4c72-9508-f239d33c5ea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:11.081269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910c94b-ab22-4e0d-b2f4-273a54b7d3a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:11.081903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c94b-ab22-4e0d-b2f4-273a54b7d3a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:11.082187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c94b-ab22-4e0d-b2f4-273a54b7d3a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:11.083021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910c94b-ab22-4e0d-b2f4-273a54b7d3a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:11.084852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b3cab0-1f82-4c72-9508-f239d33c5ea7 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:11.100935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 949/1918] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:11.193670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b0e4-fa42-4250-a990-481aa6ed4fa8 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:11.194969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b0e4-fa42-4250-a990-481aa6ed4fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:11.195337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709b0e4-fa42-4250-a990-481aa6ed4fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:11.230584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910c94b-ab22-4e0d-b2f4-273a54b7d3a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:11.233887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4910c94b-ab22-4e0d-b2f4-273a54b7d3a5 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:11.255223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 970/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:11.266754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e709b0e4-fa42-4250-a990-481aa6ed4fa8 None None] MFA Rules not processed for user `02f9f388c16748c086f09f20e4853d47`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:11.269517 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e709b0e4-fa42-4250-a990-481aa6ed4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:11.461354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 950/1920] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:11.473460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aece0-e324-47e5-928d-225fea480618 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:11.473763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aece0-e324-47e5-928d-225fea480618 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:11.487044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566aece0-e324-47e5-928d-225fea480618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:11.512130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:11.524616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-566aece0-e324-47e5-928d-225fea480618 None None] MFA Rules not processed for user `28f840eb92834e7eb976778886267012`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:11.527507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-566aece0-e324-47e5-928d-225fea480618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:11.650258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 971/1921] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:11.745826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709b0e4-fa42-4250-a990-481aa6ed4fa8 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:11.748610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e709b0e4-fa42-4250-a990-481aa6ed4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:11.875816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709b0e4-fa42-4250-a990-481aa6ed4fa8 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:11.881337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f88791-e68f-473c-a4e8-488934363758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:11.882029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88791-e68f-473c-a4e8-488934363758 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:11.882403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88791-e68f-473c-a4e8-488934363758 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:11.882749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f88791-e68f-473c-a4e8-488934363758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:11.891187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88791-e68f-473c-a4e8-488934363758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:11.893099 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f88791-e68f-473c-a4e8-488934363758 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:11.902910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 951/1922] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:12.317320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aece0-e324-47e5-928d-225fea480618 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:12.327045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566aece0-e324-47e5-928d-225fea480618 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:12.340534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca112-cebf-400f-bc6c-d49023f9e633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:12.341175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca112-cebf-400f-bc6c-d49023f9e633 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:12.341457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca112-cebf-400f-bc6c-d49023f9e633 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:12.341734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca112-cebf-400f-bc6c-d49023f9e633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:12.444779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cca112-cebf-400f-bc6c-d49023f9e633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:12.447202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cca112-cebf-400f-bc6c-d49023f9e633 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:12.480663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 972/1923] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:13.900754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fdbe6-7b02-41aa-b61e-a67776150551 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:13.901222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fdbe6-7b02-41aa-b61e-a67776150551 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:13.901425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fdbe6-7b02-41aa-b61e-a67776150551 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:13.903088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 952/1924] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:19:13.932607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11af3-eab2-4bf1-97b6-430537589895 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:13.933154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11af3-eab2-4bf1-97b6-430537589895 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:13.933282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11af3-eab2-4bf1-97b6-430537589895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:13.966473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-99f11af3-eab2-4bf1-97b6-430537589895 None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:13.970050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-99f11af3-eab2-4bf1-97b6-430537589895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:14.001477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 973/1925] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:19:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:14.024746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fdbe6-7b02-41aa-b61e-a67776150551 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:14.026653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4f2fdbe6-7b02-41aa-b61e-a67776150551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:14.069594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fdbe6-7b02-41aa-b61e-a67776150551 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:14.075861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ee818-a363-40b7-9e00-508df74bd0cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:14.076000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee818-a363-40b7-9e00-508df74bd0cc service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:14.076241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee818-a363-40b7-9e00-508df74bd0cc service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:14.076522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee818-a363-40b7-9e00-508df74bd0cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:14.088282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ee818-a363-40b7-9e00-508df74bd0cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:14.089914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ee818-a363-40b7-9e00-508df74bd0cc service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:14.102272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 953/1926] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:15.771167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11af3-eab2-4bf1-97b6-430537589895 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:15.814157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11af3-eab2-4bf1-97b6-430537589895 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:15.821118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0a111-6057-4470-89b6-6dbf0580133a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:15.822543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a111-6057-4470-89b6-6dbf0580133a service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:15.822975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a111-6057-4470-89b6-6dbf0580133a service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:15.828046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0a111-6057-4470-89b6-6dbf0580133a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:15.951488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a111-6057-4470-89b6-6dbf0580133a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:15.953802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0a111-6057-4470-89b6-6dbf0580133a service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:15.979571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 974/1927] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:16.507941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ee818-a363-40b7-9e00-508df74bd0cc service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:16.549445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:16.588049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ee818-a363-40b7-9e00-508df74bd0cc service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:16.594333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:16.595404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:16.595691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:16.595972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] PATH_INFO: `/v3/users/ab094f75b6ec4bd088eaf2d916e943da` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:16.597420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab094f75b6ec4bd088eaf2d916e943da)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:16.599660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:16.676324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab094f75b6ec4bd088eaf2d916e943da'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:16.690083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab094f75b6ec4bd088eaf2d916e943da'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:16.690746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab094f75b6ec4bd088eaf2d916e943da'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:16.691382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab094f75b6ec4bd088eaf2d916e943da'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:16.700285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab094f75b6ec4bd088eaf2d916e943da'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:16.718190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 954/1928] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:16 2022] DELETE /identity/v3/users/ab094f75b6ec4bd088eaf2d916e943da => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:16.723586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c08f0-d2d2-4f00-b5d5-dad1b5e19208 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:16.724087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c08f0-d2d2-4f00-b5d5-dad1b5e19208 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:16.724369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c08f0-d2d2-4f00-b5d5-dad1b5e19208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:16.744010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-579c08f0-d2d2-4f00-b5d5-dad1b5e19208 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:16.745475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-579c08f0-d2d2-4f00-b5d5-dad1b5e19208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:16.781497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:16.817812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 975/1929] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:16.828619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:16.830141 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:16.917066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ee3cc-e2a1-4001-b83d-21473ebee109 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:16.922044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aa7c9-fc1b-4476-a1c7-8f39606158e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:16.922044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa7c9-fc1b-4476-a1c7-8f39606158e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:16.922411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa7c9-fc1b-4476-a1c7-8f39606158e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:16.922511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51aa7c9-fc1b-4476-a1c7-8f39606158e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:16.938358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aa7c9-fc1b-4476-a1c7-8f39606158e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:16.940130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51aa7c9-fc1b-4476-a1c7-8f39606158e1 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:16.955479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 955/1930] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:17.348391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c08f0-d2d2-4f00-b5d5-dad1b5e19208 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:17.350056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-579c08f0-d2d2-4f00-b5d5-dad1b5e19208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:17.364348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c08f0-d2d2-4f00-b5d5-dad1b5e19208 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:17.369524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:17.370180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:17.370465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:17.370956 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] PATH_INFO: `/v3/projects/b53f5eba54af4d58a357f0930248ce7a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:17.372320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53f5eba54af4d58a357f0930248ce7a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:17.376105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:17.445134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53f5eba54af4d58a357f0930248ce7a', 'request_id': 'req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.452407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53f5eba54af4d58a357f0930248ce7a', 'request_id': 'req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.505008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53f5eba54af4d58a357f0930248ce7a', 'request_id': 'req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.549392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] The token cache is being invalidate because project b53f5eba54af4d58a357f0930248ce7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:17.549696 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.551022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.555036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 976/1931] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:17 2022] DELETE /identity/v3/projects/b53f5eba54af4d58a357f0930248ce7a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:17.556868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aa7c9-fc1b-4476-a1c7-8f39606158e1 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:17.570808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51aa7c9-fc1b-4476-a1c7-8f39606158e1 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:17.684209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:17.717268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:17.719556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:17.720226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:17.720675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] PATH_INFO: `/v3/users/03fd409e726748ac80285295b451a347` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:17.722638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fd409e726748ac80285295b451a347)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:17.728790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:17.841541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fd409e726748ac80285295b451a347'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.856418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fd409e726748ac80285295b451a347'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.857234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fd409e726748ac80285295b451a347'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.858226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fd409e726748ac80285295b451a347'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.868925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fd409e726748ac80285295b451a347'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:17.893881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 956/1932] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:17 2022] DELETE /identity/v3/users/03fd409e726748ac80285295b451a347 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:18.589130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:18.590730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:18.611058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50564d-aa00-440f-b1ac-5a1a2ca2c856 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:18.639713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:18.642143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:18.683668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:18.684332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:18.684678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:18.684962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] PATH_INFO: `/v3/projects/ed33499e085b4d2cb8c24e60d90769ce` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:18.686748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed33499e085b4d2cb8c24e60d90769ce)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:18.689915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:18.725790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a2b4-35a7-4695-8fe1-915fd570f4a8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:18.731417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:18.732543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:18.732837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:18.733137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] PATH_INFO: `/v3/users/ff9d0ff3dbf94c099565647c73d66dab` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:18.735700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9d0ff3dbf94c099565647c73d66dab)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:18.737574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:18.751632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed33499e085b4d2cb8c24e60d90769ce', 'request_id': 'req-f5bf746e-b988-4fdf-88f7-8f3313702436'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.764327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed33499e085b4d2cb8c24e60d90769ce', 'request_id': 'req-f5bf746e-b988-4fdf-88f7-8f3313702436'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.774343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed33499e085b4d2cb8c24e60d90769ce', 'request_id': 'req-f5bf746e-b988-4fdf-88f7-8f3313702436'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.777971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:18.791723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] The token cache is being invalidate because project ed33499e085b4d2cb8c24e60d90769ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:18.792122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.793045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.795244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 977/1933] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:18 2022] DELETE /identity/v3/projects/ed33499e085b4d2cb8c24e60d90769ce => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:18.800000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:18.801619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:18.811933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9d0ff3dbf94c099565647c73d66dab'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.823694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9d0ff3dbf94c099565647c73d66dab'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.824432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9d0ff3dbf94c099565647c73d66dab'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.825128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9d0ff3dbf94c099565647c73d66dab'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.835031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-83241376-9cd3-4072-912d-aace3d4274cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9d0ff3dbf94c099565647c73d66dab'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:18.840995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:18.863865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 957/1934] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:18 2022] DELETE /identity/v3/users/ff9d0ff3dbf94c099565647c73d66dab => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:18.868673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4fb0-d7ee-4f16-bee2-cde4dfeeb8c7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:18.869376 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4fb0-d7ee-4f16-bee2-cde4dfeeb8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:18.869899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d4fb0-d7ee-4f16-bee2-cde4dfeeb8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:18.912472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b75d4fb0-d7ee-4f16-bee2-cde4dfeeb8c7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:18.914260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b75d4fb0-d7ee-4f16-bee2-cde4dfeeb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:18.956806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf746e-b988-4fdf-88f7-8f3313702436 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:19.017486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 958/1935] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:19.027232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d4fb0-d7ee-4f16-bee2-cde4dfeeb8c7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:19.028746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b75d4fb0-d7ee-4f16-bee2-cde4dfeeb8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:19.041878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:19.042529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:19.042816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:19.043132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] PATH_INFO: `/v3/users/fbef193c94ad496a8424889614f8523f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:19.044299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbef193c94ad496a8424889614f8523f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:19.046224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:19.113630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d4fb0-d7ee-4f16-bee2-cde4dfeeb8c7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:19.118495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:19.119273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:19.119657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:19.120216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:19.120695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbef193c94ad496a8424889614f8523f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.130721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbef193c94ad496a8424889614f8523f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.131619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbef193c94ad496a8424889614f8523f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.131757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:19.132257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbef193c94ad496a8424889614f8523f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.133324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:19.144015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 959/1936] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:19.152602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbef193c94ad496a8424889614f8523f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.168057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 978/1937] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:18 2022] DELETE /identity/v3/users/fbef193c94ad496a8424889614f8523f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:19.466449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:19.468020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:19.484421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eadf98-5a2c-4080-8dc2-c11217f1b7aa service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:19.558269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:19.559039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:19.559329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:19.559659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] PATH_INFO: `/v3/projects/4d60bbc4dfec4c67a88ffe01af904542` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:19.560936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d60bbc4dfec4c67a88ffe01af904542)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:19.563481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:19.615412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:19.633766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d60bbc4dfec4c67a88ffe01af904542', 'request_id': 'req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.647709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d60bbc4dfec4c67a88ffe01af904542', 'request_id': 'req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.676868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:19.680711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d60bbc4dfec4c67a88ffe01af904542', 'request_id': 'req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.681197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:19.701755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] The token cache is being invalidate because project 4d60bbc4dfec4c67a88ffe01af904542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:19.701755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.702638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.704863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 960/1938] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:19 2022] DELETE /identity/v3/projects/4d60bbc4dfec4c67a88ffe01af904542 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:19.705596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95566691-817d-42b6-a49b-6380ee2c0ac5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:19.709065 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:19.711727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:19.739176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:19.811081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a96d4-9f26-4b08-8ede-1f2f6946182e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:19.815405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:19.816463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:19.816627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:19.816854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:19.817206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] PATH_INFO: `/v3/projects/2696695f7b194e61ad02ad344fd8e61c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:19.817309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:19.817549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:19.817858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] PATH_INFO: `/v3/users/7a9c2642ec8a4f00b4462da4905f7cb3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:19.818850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2696695f7b194e61ad02ad344fd8e61c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:19.821437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:19.831397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9c2642ec8a4f00b4462da4905f7cb3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:19.834923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:19.896219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2696695f7b194e61ad02ad344fd8e61c', 'request_id': 'req-0baf6772-c98a-421d-803d-ecdf7c66884e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.906955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2696695f7b194e61ad02ad344fd8e61c', 'request_id': 'req-0baf6772-c98a-421d-803d-ecdf7c66884e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.917836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2696695f7b194e61ad02ad344fd8e61c', 'request_id': 'req-0baf6772-c98a-421d-803d-ecdf7c66884e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.920969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9c2642ec8a4f00b4462da4905f7cb3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.931256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9c2642ec8a4f00b4462da4905f7cb3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.933038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9c2642ec8a4f00b4462da4905f7cb3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.933599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9c2642ec8a4f00b4462da4905f7cb3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.937447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] The token cache is being invalidate because project 2696695f7b194e61ad02ad344fd8e61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:19.937746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.938544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0baf6772-c98a-421d-803d-ecdf7c66884e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.943932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 979/1939] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:19 2022] DELETE /identity/v3/projects/2696695f7b194e61ad02ad344fd8e61c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:19.944076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2a472fdf-b167-4314-81dd-e8d6a84d9a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9c2642ec8a4f00b4462da4905f7cb3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:19.944954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a47de-92a4-494a-a980-7cb63c1c43e9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:19.945239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a47de-92a4-494a-a980-7cb63c1c43e9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:19.945565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a47de-92a4-494a-a980-7cb63c1c43e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:19.966123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 961/1940] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:19 2022] DELETE /identity/v3/users/7a9c2642ec8a4f00b4462da4905f7cb3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:19.973181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-699a47de-92a4-494a-a980-7cb63c1c43e9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:19.974460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-699a47de-92a4-494a-a980-7cb63c1c43e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:20.062265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 980/1941] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:20.071692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f4b9-85f4-44f2-bf0a-a7f727b7d0f5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.072154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f4b9-85f4-44f2-bf0a-a7f727b7d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.072746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908f4b9-85f4-44f2-bf0a-a7f727b7d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.115343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5908f4b9-85f4-44f2-bf0a-a7f727b7d0f5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:20.116868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5908f4b9-85f4-44f2-bf0a-a7f727b7d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:20.131080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 962/1942] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:20.132318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a47de-92a4-494a-a980-7cb63c1c43e9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.143490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a47de-92a4-494a-a980-7cb63c1c43e9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.160179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.160461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.160748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.161031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.161697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:20.162005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.164091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.183474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 981/1943] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:20.188114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908f4b9-85f4-44f2-bf0a-a7f727b7d0f5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.202355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908f4b9-85f4-44f2-bf0a-a7f727b7d0f5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.219442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1cc29-ff7a-4a26-90b9-768dafe643b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.219442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1cc29-ff7a-4a26-90b9-768dafe643b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.219442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1cc29-ff7a-4a26-90b9-768dafe643b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.219442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1cc29-ff7a-4a26-90b9-768dafe643b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.220010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1cc29-ff7a-4a26-90b9-768dafe643b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.220010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1cc29-ff7a-4a26-90b9-768dafe643b6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.256243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 963/1944] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:20 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:20.257568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.269486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2cec7-2543-448c-90f2-a9b5ac41abbd admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.313688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:20.341380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a439280-f593-43ef-9359-5b1cdafcd52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.342031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439280-f593-43ef-9359-5b1cdafcd52d admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.342310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439280-f593-43ef-9359-5b1cdafcd52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.342583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439280-f593-43ef-9359-5b1cdafcd52d admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.343258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a439280-f593-43ef-9359-5b1cdafcd52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.346121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a439280-f593-43ef-9359-5b1cdafcd52d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.371381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 982/1945] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:20 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:20.372669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1cc29-ff7a-4a26-90b9-768dafe643b6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.384274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1cc29-ff7a-4a26-90b9-768dafe643b6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.389017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128f3a8-3536-48af-b072-08f7d0fd18a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.389611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128f3a8-3536-48af-b072-08f7d0fd18a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.389888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128f3a8-3536-48af-b072-08f7d0fd18a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.390157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1128f3a8-3536-48af-b072-08f7d0fd18a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.391818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128f3a8-3536-48af-b072-08f7d0fd18a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.393403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1128f3a8-3536-48af-b072-08f7d0fd18a0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.399083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:20.405947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 964/1946] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:20.409113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a439280-f593-43ef-9359-5b1cdafcd52d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.420285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a439280-f593-43ef-9359-5b1cdafcd52d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.441927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.442597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.443340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.443450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.444528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.446234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.462786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 983/1947] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:20.464046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128f3a8-3536-48af-b072-08f7d0fd18a0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.472411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.474643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:20.477383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1128f3a8-3536-48af-b072-08f7d0fd18a0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.488637 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec16bea-fdd0-459b-be42-fa3b6c8c97bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.489171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810de609-c1ce-4924-a615-f39c8dfe0ffa admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.489322 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16bea-fdd0-459b-be42-fa3b6c8c97bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.489585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16bea-fdd0-459b-be42-fa3b6c8c97bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.489858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16bea-fdd0-459b-be42-fa3b6c8c97bc admin admin] PATH_INFO: `/v3/projects/74cb3426ae37497aa13465fd24439d19/users/3bd6ee5b0c524d49bb8f0b6e84d6f26e/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.493810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.494440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.494722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.495065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] PATH_INFO: `/v3/projects/ec89152b16ec48fba3133e3bdd9418dc` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.496327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec89152b16ec48fba3133e3bdd9418dc)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.498207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.506805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec16bea-fdd0-459b-be42-fa3b6c8c97bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cb3426ae37497aa13465fd24439d19, user_id=3bd6ee5b0c524d49bb8f0b6e84d6f26e, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.509763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec16bea-fdd0-459b-be42-fa3b6c8c97bc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.524437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 965/1948] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:20 2022] PUT /identity/v3/projects/74cb3426ae37497aa13465fd24439d19/users/3bd6ee5b0c524d49bb8f0b6e84d6f26e/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:20.535753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0895-5821-4312-b2a1-74306770c783 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.536038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0895-5821-4312-b2a1-74306770c783 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.536311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f0895-5821-4312-b2a1-74306770c783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.553672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec89152b16ec48fba3133e3bdd9418dc', 'request_id': 'req-e7fe2184-793e-490e-9e78-b9718b37010d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.560048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec89152b16ec48fba3133e3bdd9418dc', 'request_id': 'req-e7fe2184-793e-490e-9e78-b9718b37010d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.564794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-973f0895-5821-4312-b2a1-74306770c783 None None] MFA Rules not processed for user `3bd6ee5b0c524d49bb8f0b6e84d6f26e`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:20.566452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-973f0895-5821-4312-b2a1-74306770c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:20.568413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec89152b16ec48fba3133e3bdd9418dc', 'request_id': 'req-e7fe2184-793e-490e-9e78-b9718b37010d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.580820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] The token cache is being invalidate because project ec89152b16ec48fba3133e3bdd9418dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:20.581115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.581763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.583501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 984/1949] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:20 2022] DELETE /identity/v3/projects/ec89152b16ec48fba3133e3bdd9418dc => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:20.587326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.588389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:20.634607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 966/1950] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:20.638892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f0895-5821-4312-b2a1-74306770c783 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.641112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-973f0895-5821-4312-b2a1-74306770c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:20.655466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2184-793e-490e-9e78-b9718b37010d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.660296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.660925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.661200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.661472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] PATH_INFO: `/v3/users/35344278b04d49709ea57a0b5cb1495e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.662599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35344278b04d49709ea57a0b5cb1495e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.664563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.719690 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:20.728708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35344278b04d49709ea57a0b5cb1495e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.732106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f0895-5821-4312-b2a1-74306770c783 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.739660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35344278b04d49709ea57a0b5cb1495e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.740778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f1b6-c5b6-4a13-b2da-66c856b6131d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.741498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35344278b04d49709ea57a0b5cb1495e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.742584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f1b6-c5b6-4a13-b2da-66c856b6131d admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.742892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f1b6-c5b6-4a13-b2da-66c856b6131d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.743194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35344278b04d49709ea57a0b5cb1495e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.743294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f1b6-c5b6-4a13-b2da-66c856b6131d admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.746014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f1b6-c5b6-4a13-b2da-66c856b6131d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.747133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f1b6-c5b6-4a13-b2da-66c856b6131d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:20.761130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35344278b04d49709ea57a0b5cb1495e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:20.775955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 985/1951] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:20 2022] DELETE /identity/v3/users/35344278b04d49709ea57a0b5cb1495e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:20.782226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 967/1952] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:20 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:20.786284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:20.788951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:20.895154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de218f-cd21-410e-8f47-cd3777678a35 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:20.983958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85518889-453d-4c56-a7bd-e79060ffca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:20.984604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518889-453d-4c56-a7bd-e79060ffca55 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:20.984914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518889-453d-4c56-a7bd-e79060ffca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:20.985196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518889-453d-4c56-a7bd-e79060ffca55 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:20.986358 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85518889-453d-4c56-a7bd-e79060ffca55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:20.989742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85518889-453d-4c56-a7bd-e79060ffca55 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.013767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 986/1953] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:20 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:21.018309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f1b6-c5b6-4a13-b2da-66c856b6131d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.029757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f1b6-c5b6-4a13-b2da-66c856b6131d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.035359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355660c-e602-422f-a880-22c049d6a79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.035972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355660c-e602-422f-a880-22c049d6a79d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.036255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355660c-e602-422f-a880-22c049d6a79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.036532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355660c-e602-422f-a880-22c049d6a79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.037175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355660c-e602-422f-a880-22c049d6a79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.038763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355660c-e602-422f-a880-22c049d6a79d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.050786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 968/1954] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:21.055292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85518889-453d-4c56-a7bd-e79060ffca55 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.067855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85518889-453d-4c56-a7bd-e79060ffca55 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.076977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ade23d-4900-4c1c-888d-5b16803439d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.077895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade23d-4900-4c1c-888d-5b16803439d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.078204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade23d-4900-4c1c-888d-5b16803439d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.078458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ade23d-4900-4c1c-888d-5b16803439d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.079139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ade23d-4900-4c1c-888d-5b16803439d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.081496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ade23d-4900-4c1c-888d-5b16803439d1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.095164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 987/1955] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:21.098634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355660c-e602-422f-a880-22c049d6a79d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.108648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355660c-e602-422f-a880-22c049d6a79d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.114031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b27811-d63e-48ac-98ca-1d6d2fb5f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.114717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b27811-d63e-48ac-98ca-1d6d2fb5f15e admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.115018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b27811-d63e-48ac-98ca-1d6d2fb5f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.115413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b27811-d63e-48ac-98ca-1d6d2fb5f15e admin admin] PATH_INFO: `/v3/projects/f2ff2fb3dfda4ed7b41b70b3e2c88697/users/84e26ee06ad640af99fc795a3ed9b5a2/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.133145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b27811-d63e-48ac-98ca-1d6d2fb5f15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ff2fb3dfda4ed7b41b70b3e2c88697, user_id=84e26ee06ad640af99fc795a3ed9b5a2, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.136179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b27811-d63e-48ac-98ca-1d6d2fb5f15e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.151581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 969/1956] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:21 2022] PUT /identity/v3/projects/f2ff2fb3dfda4ed7b41b70b3e2c88697/users/84e26ee06ad640af99fc795a3ed9b5a2/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:21.164153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844285-0346-4b93-aa61-3ea6dae06bf9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.164462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844285-0346-4b93-aa61-3ea6dae06bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.164912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844285-0346-4b93-aa61-3ea6dae06bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.200438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7a844285-0346-4b93-aa61-3ea6dae06bf9 None None] MFA Rules not processed for user `84e26ee06ad640af99fc795a3ed9b5a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:21.201824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7a844285-0346-4b93-aa61-3ea6dae06bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:21.261259 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:21.333552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 988/1957] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:21.334894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b27811-d63e-48ac-98ca-1d6d2fb5f15e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.384445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:21.396402 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844285-0346-4b93-aa61-3ea6dae06bf9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.398578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7a844285-0346-4b93-aa61-3ea6dae06bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:21.476708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b27811-d63e-48ac-98ca-1d6d2fb5f15e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.487937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f638bc8-8845-4cb6-abe4-70e65a0fa9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.488885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f638bc8-8845-4cb6-abe4-70e65a0fa9ee admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.490647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f638bc8-8845-4cb6-abe4-70e65a0fa9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.491208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f638bc8-8845-4cb6-abe4-70e65a0fa9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.491932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f638bc8-8845-4cb6-abe4-70e65a0fa9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.496207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f638bc8-8845-4cb6-abe4-70e65a0fa9ee admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.522100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844285-0346-4b93-aa61-3ea6dae06bf9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.530606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.532125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.532703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.533010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] PATH_INFO: `/v3/projects/378bd1fd80c6423f9febb5e6e76dc2c3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.534664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] RBAC: Authorizing `identity:delete_project(project_id=378bd1fd80c6423f9febb5e6e76dc2c3)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.536468 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.551280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 970/1958] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:21 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:21.552548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f638bc8-8845-4cb6-abe4-70e65a0fa9ee admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.603461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378bd1fd80c6423f9febb5e6e76dc2c3', 'request_id': 'req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:21.614087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378bd1fd80c6423f9febb5e6e76dc2c3', 'request_id': 'req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:21.626778 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378bd1fd80c6423f9febb5e6e76dc2c3', 'request_id': 'req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:21.656731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f638bc8-8845-4cb6-abe4-70e65a0fa9ee admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.658651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] The token cache is being invalidate because project 378bd1fd80c6423f9febb5e6e76dc2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:21.658952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:21.659669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0fcefe0b-41b1-4d4c-948d-59f40bb1925c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:21.661478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 989/1959] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:21 2022] DELETE /identity/v3/projects/378bd1fd80c6423f9febb5e6e76dc2c3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:21.667117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0ed57-fc13-406e-bbde-d9266d5f29cc None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.667841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0ed57-fc13-406e-bbde-d9266d5f29cc None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.668132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0ed57-fc13-406e-bbde-d9266d5f29cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.701450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-71d0ed57-fc13-406e-bbde-d9266d5f29cc None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:21.703521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-71d0ed57-fc13-406e-bbde-d9266d5f29cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:21.750719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.751743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.752150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.752994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.753725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.756798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.782540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 971/1960] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:21 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:21.786485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.788163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:21.793732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 990/1961] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:21.803735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f42074-32ea-47be-8c60-499d8f1ea058 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.804119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74cbc0-2bf7-4bb5-9b1a-5e4746068b0d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.804815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74cbc0-2bf7-4bb5-9b1a-5e4746068b0d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.805316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74cbc0-2bf7-4bb5-9b1a-5e4746068b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.808902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db1d9f-b4d3-41a9-bf4f-436e90c06614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.809592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1d9f-b4d3-41a9-bf4f-436e90c06614 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.810466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1d9f-b4d3-41a9-bf4f-436e90c06614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.810466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db1d9f-b4d3-41a9-bf4f-436e90c06614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.810876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db1d9f-b4d3-41a9-bf4f-436e90c06614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.813961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db1d9f-b4d3-41a9-bf4f-436e90c06614 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.820511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:21.831038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 972/1962] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:21.835603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db1d9f-b4d3-41a9-bf4f-436e90c06614 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.849877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db1d9f-b4d3-41a9-bf4f-436e90c06614 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.850761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8e74cbc0-2bf7-4bb5-9b1a-5e4746068b0d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:21.852656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8e74cbc0-2bf7-4bb5-9b1a-5e4746068b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:21.856878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f85cf-7e4d-4f3e-93fa-11cb3c5b834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.857939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f85cf-7e4d-4f3e-93fa-11cb3c5b834a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.858204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f85cf-7e4d-4f3e-93fa-11cb3c5b834a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.858472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f85cf-7e4d-4f3e-93fa-11cb3c5b834a admin admin] PATH_INFO: `/v3/projects/4972aa0cf1584573a9e2e75edcac99ac/users/e0f270d82b2d4070980ef5b6f1815b2f/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.863817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 991/1963] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:21.867921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74cbc0-2bf7-4bb5-9b1a-5e4746068b0d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.880555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f85cf-7e4d-4f3e-93fa-11cb3c5b834a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4972aa0cf1584573a9e2e75edcac99ac, user_id=e0f270d82b2d4070980ef5b6f1815b2f, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.882246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74cbc0-2bf7-4bb5-9b1a-5e4746068b0d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:21.884291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f85cf-7e4d-4f3e-93fa-11cb3c5b834a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.887305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:21.888193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:21.888552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:21.888852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:21.889557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:21.889864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:21.891670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:21.902805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 973/1964] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:21 2022] PUT /identity/v3/projects/4972aa0cf1584573a9e2e75edcac99ac/users/e0f270d82b2d4070980ef5b6f1815b2f/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:21.907615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f85cf-7e4d-4f3e-93fa-11cb3c5b834a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.910035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 992/1965] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:21.914428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:21.915963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:21.930664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e66e2-ff29-42b9-83ed-2cbbe1884827 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.012452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5297-e3af-4650-8ff4-f34e024acc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.013169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5297-e3af-4650-8ff4-f34e024acc8a admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.014149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5297-e3af-4650-8ff4-f34e024acc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.014438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5297-e3af-4650-8ff4-f34e024acc8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.015108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee5297-e3af-4650-8ff4-f34e024acc8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.017520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee5297-e3af-4650-8ff4-f34e024acc8a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.053956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f85cf-7e4d-4f3e-93fa-11cb3c5b834a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.059162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 993/1966] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:21 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:22.063291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5297-e3af-4650-8ff4-f34e024acc8a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:22.065134 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e261214-3e49-42fb-b830-72bd1fdc68a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.066594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e261214-3e49-42fb-b830-72bd1fdc68a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.068174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e261214-3e49-42fb-b830-72bd1fdc68a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.068662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e261214-3e49-42fb-b830-72bd1fdc68a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.071096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e261214-3e49-42fb-b830-72bd1fdc68a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.075116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e261214-3e49-42fb-b830-72bd1fdc68a1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.090383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 974/1967] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:22.092018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e261214-3e49-42fb-b830-72bd1fdc68a1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:22.107162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e261214-3e49-42fb-b830-72bd1fdc68a1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.168585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5297-e3af-4650-8ff4-f34e024acc8a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.176621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784bd05-a882-4770-9586-b4659556a846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.178117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784bd05-a882-4770-9586-b4659556a846 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.178573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784bd05-a882-4770-9586-b4659556a846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.179130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784bd05-a882-4770-9586-b4659556a846 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.179999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784bd05-a882-4770-9586-b4659556a846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.182222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784bd05-a882-4770-9586-b4659556a846 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.193136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76dc62-2aba-4699-ab63-93f8bc94f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.194383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dc62-2aba-4699-ab63-93f8bc94f251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.195273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dc62-2aba-4699-ab63-93f8bc94f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.195797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dc62-2aba-4699-ab63-93f8bc94f251 admin admin] PATH_INFO: `/v3/projects/4972aa0cf1584573a9e2e75edcac99ac/users/e0f270d82b2d4070980ef5b6f1815b2f/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.199328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76dc62-2aba-4699-ab63-93f8bc94f251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4972aa0cf1584573a9e2e75edcac99ac, user_id=e0f270d82b2d4070980ef5b6f1815b2f, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.202578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76dc62-2aba-4699-ab63-93f8bc94f251 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.216223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 994/1968] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:22 2022] POST /identity/v3/users => generated 305 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:22.219106 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784bd05-a882-4770-9586-b4659556a846 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:22.233325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 975/1969] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:22 2022] PUT /identity/v3/projects/4972aa0cf1584573a9e2e75edcac99ac/users/e0f270d82b2d4070980ef5b6f1815b2f/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:22.236341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad35eba-139e-4eb5-8354-d80d04bee31b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.236953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad35eba-139e-4eb5-8354-d80d04bee31b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.237413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad35eba-139e-4eb5-8354-d80d04bee31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.242218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784bd05-a882-4770-9586-b4659556a846 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.283615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3ad35eba-139e-4eb5-8354-d80d04bee31b None None] MFA Rules not processed for user `e0f270d82b2d4070980ef5b6f1815b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:22.285038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3ad35eba-139e-4eb5-8354-d80d04bee31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:22.316320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:22.324761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f481-2717-4f51-b64c-a972001610eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.325968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f481-2717-4f51-b64c-a972001610eb admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.326576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f481-2717-4f51-b64c-a972001610eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.327043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7f481-2717-4f51-b64c-a972001610eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.327884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7f481-2717-4f51-b64c-a972001610eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.330853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7f481-2717-4f51-b64c-a972001610eb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.349982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 995/1970] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:22.351490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f481-2717-4f51-b64c-a972001610eb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:22.365601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7f481-2717-4f51-b64c-a972001610eb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.372047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a88b-5d38-493f-96c5-1fb09e3087d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.372844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a88b-5d38-493f-96c5-1fb09e3087d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.373288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a88b-5d38-493f-96c5-1fb09e3087d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.373880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a88b-5d38-493f-96c5-1fb09e3087d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.375962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a88b-5d38-493f-96c5-1fb09e3087d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.381175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a88b-5d38-493f-96c5-1fb09e3087d0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.398665 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 976/1971] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:22.411247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 996/1972] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:22.411908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad35eba-139e-4eb5-8354-d80d04bee31b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:22.418125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a88b-5d38-493f-96c5-1fb09e3087d0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:22.419963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3ad35eba-139e-4eb5-8354-d80d04bee31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:22.443135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a88b-5d38-493f-96c5-1fb09e3087d0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.458393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13df51-e396-4469-a205-e2171f89e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.459098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13df51-e396-4469-a205-e2171f89e148 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.459381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13df51-e396-4469-a205-e2171f89e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.459657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13df51-e396-4469-a205-e2171f89e148 admin admin] PATH_INFO: `/v3/projects/ccd3edb646ad447da159cb3b08692bef/users/da387c725330429ab85df21c1821537b/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.460810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:22.489979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13df51-e396-4469-a205-e2171f89e148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd3edb646ad447da159cb3b08692bef, user_id=da387c725330429ab85df21c1821537b, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.492764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13df51-e396-4469-a205-e2171f89e148 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.534167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 997/1973] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:22 2022] PUT /identity/v3/projects/ccd3edb646ad447da159cb3b08692bef/users/da387c725330429ab85df21c1821537b/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:22.548823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b77b5-2d6c-4a6e-8851-8f03ddb88f62 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.549115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b77b5-2d6c-4a6e-8851-8f03ddb88f62 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.549393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b77b5-2d6c-4a6e-8851-8f03ddb88f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.568503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad35eba-139e-4eb5-8354-d80d04bee31b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.642126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.642840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.643213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.643495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.643981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-517b77b5-2d6c-4a6e-8851-8f03ddb88f62 None None] MFA Rules not processed for user `da387c725330429ab85df21c1821537b`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:22.645218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-517b77b5-2d6c-4a6e-8851-8f03ddb88f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:22.648912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:22.747673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 998/1974] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:22.752867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b77b5-2d6c-4a6e-8851-8f03ddb88f62 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:22.759762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.761378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.772158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 977/1975] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:22.882844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b77b5-2d6c-4a6e-8851-8f03ddb88f62 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:22.887887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da7675-def3-49ed-8d1a-7a3b3cac4713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:22.888618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7675-def3-49ed-8d1a-7a3b3cac4713 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:22.888922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7675-def3-49ed-8d1a-7a3b3cac4713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:22.889197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da7675-def3-49ed-8d1a-7a3b3cac4713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:22.891121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da7675-def3-49ed-8d1a-7a3b3cac4713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:22.893146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da7675-def3-49ed-8d1a-7a3b3cac4713 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:22.933111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 999/1976] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:22 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:22.933452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:22.945581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4ecd0-b9aa-4cff-ac0c-7af995c52165 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:23.029790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba1f28-6d88-461b-8cb7-19b14371f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:23.030434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1f28-6d88-461b-8cb7-19b14371f756 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.030753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1f28-6d88-461b-8cb7-19b14371f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.031309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba1f28-6d88-461b-8cb7-19b14371f756 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.031961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba1f28-6d88-461b-8cb7-19b14371f756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:23.040998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba1f28-6d88-461b-8cb7-19b14371f756 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:23.081303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 978/1977] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:22 2022] POST /identity/v3/users => generated 309 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:23.085286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da7675-def3-49ed-8d1a-7a3b3cac4713 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:23.096781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da7675-def3-49ed-8d1a-7a3b3cac4713 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:23.102191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50adf61-3162-40f5-b355-09244cc54190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:23.102940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50adf61-3162-40f5-b355-09244cc54190 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.103353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50adf61-3162-40f5-b355-09244cc54190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.103919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50adf61-3162-40f5-b355-09244cc54190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.104661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50adf61-3162-40f5-b355-09244cc54190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:23.106545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50adf61-3162-40f5-b355-09244cc54190 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:23.118634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1000/1978] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:23.122901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba1f28-6d88-461b-8cb7-19b14371f756 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:23.138515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba1f28-6d88-461b-8cb7-19b14371f756 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:23.144389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8844e-2eae-4b24-89e8-89f389649139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:23.145396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8844e-2eae-4b24-89e8-89f389649139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.145763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8844e-2eae-4b24-89e8-89f389649139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.146134 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8844e-2eae-4b24-89e8-89f389649139 admin admin] PATH_INFO: `/v3/projects/87227c034d2842b5b18970c96336f3fa/users/ac3c16f45af34ec2ad4dd6df4b537cac/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.174186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8844e-2eae-4b24-89e8-89f389649139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87227c034d2842b5b18970c96336f3fa, user_id=ac3c16f45af34ec2ad4dd6df4b537cac, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:23.182970 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8844e-2eae-4b24-89e8-89f389649139 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:23.188100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:23.208388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 979/1979] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:23 2022] PUT /identity/v3/projects/87227c034d2842b5b18970c96336f3fa/users/ac3c16f45af34ec2ad4dd6df4b537cac/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:23.212256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50adf61-3162-40f5-b355-09244cc54190 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:23.239348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50adf61-3162-40f5-b355-09244cc54190 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:23.262208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:23.318512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f541f7b-087f-4fac-a912-f0887c50f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:23.319290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f541f7b-087f-4fac-a912-f0887c50f68c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.319672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f541f7b-087f-4fac-a912-f0887c50f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.320052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f541f7b-087f-4fac-a912-f0887c50f68c admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.320795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f541f7b-087f-4fac-a912-f0887c50f68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:23.322503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f541f7b-087f-4fac-a912-f0887c50f68c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:23.333983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1001/1980] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:23.338209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8844e-2eae-4b24-89e8-89f389649139 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:23.349884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8844e-2eae-4b24-89e8-89f389649139 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:23.354605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:23.355420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.355800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.356315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] PATH_INFO: `/v3/projects/87227c034d2842b5b18970c96336f3fa/users/ac3c16f45af34ec2ad4dd6df4b537cac/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.360161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87227c034d2842b5b18970c96336f3fa, user_id=ac3c16f45af34ec2ad4dd6df4b537cac, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:23.362948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:23.376836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 980/1981] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:23 2022] PUT /identity/v3/projects/87227c034d2842b5b18970c96336f3fa/users/ac3c16f45af34ec2ad4dd6df4b537cac/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:23.387038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d9b7-334f-4035-b48b-5eaae61252a8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.387428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d9b7-334f-4035-b48b-5eaae61252a8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.387817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460d9b7-334f-4035-b48b-5eaae61252a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.421484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3460d9b7-334f-4035-b48b-5eaae61252a8 None None] MFA Rules not processed for user `ac3c16f45af34ec2ad4dd6df4b537cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:23.422870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3460d9b7-334f-4035-b48b-5eaae61252a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:23.505864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1002/1982] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:23.519079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:23.521155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:23.586598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405d24b-6175-4c51-87e3-0e22d1b9f29f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:23.591215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9112-be88-4c0a-9f74-393dd76f7202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:23.592369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9112-be88-4c0a-9f74-393dd76f7202 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.592803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9112-be88-4c0a-9f74-393dd76f7202 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.593296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9112-be88-4c0a-9f74-393dd76f7202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.612408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b9112-be88-4c0a-9f74-393dd76f7202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:23.613879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b9112-be88-4c0a-9f74-393dd76f7202 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:23.625672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 981/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:23.794243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460d9b7-334f-4035-b48b-5eaae61252a8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:23.803861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460d9b7-334f-4035-b48b-5eaae61252a8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:23.807592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807e591-40cf-4b38-9e36-f4410e546682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:23.808284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e591-40cf-4b38-9e36-f4410e546682 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:23.808660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e591-40cf-4b38-9e36-f4410e546682 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:23.809005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807e591-40cf-4b38-9e36-f4410e546682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:23.877717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807e591-40cf-4b38-9e36-f4410e546682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:23.879449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807e591-40cf-4b38-9e36-f4410e546682 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:23.889791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1003/1984] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:24.491507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9112-be88-4c0a-9f74-393dd76f7202 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:24.503112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9112-be88-4c0a-9f74-393dd76f7202 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:24.506822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:24.507526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:24.507875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:24.508223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:24.510005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:24.578017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:24.579498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:24.588519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 982/1985] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:25.262845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807e591-40cf-4b38-9e36-f4410e546682 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:25.276512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807e591-40cf-4b38-9e36-f4410e546682 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:25.286564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261611d-ddeb-4962-9f0a-5fd43614148c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:25.287305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261611d-ddeb-4962-9f0a-5fd43614148c service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:25.287655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261611d-ddeb-4962-9f0a-5fd43614148c service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:25.287999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261611d-ddeb-4962-9f0a-5fd43614148c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:25.342009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:25.378115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261611d-ddeb-4962-9f0a-5fd43614148c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:25.379709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261611d-ddeb-4962-9f0a-5fd43614148c service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:25.396822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1004/1986] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:28.465976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:28.467419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:28.546423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7b336-cb0f-4e3a-9a10-e4cc0337af66 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:28.551310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:28.551952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:28.552346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:28.552505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] PATH_INFO: `/v3/users/bff40a77fa4544829136e7bf0bcd8c37` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:28.553691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bff40a77fa4544829136e7bf0bcd8c37)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:28.555701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:28.586048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:28.620851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff40a77fa4544829136e7bf0bcd8c37'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:28.635323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff40a77fa4544829136e7bf0bcd8c37'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:28.635972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff40a77fa4544829136e7bf0bcd8c37'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:28.636582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff40a77fa4544829136e7bf0bcd8c37'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:28.644844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff40a77fa4544829136e7bf0bcd8c37'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:28.664548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 983/1987] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:28 2022] DELETE /identity/v3/users/bff40a77fa4544829136e7bf0bcd8c37 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:28.669022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699d39-bb5e-48ab-9308-59217d569493 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:28.669488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699d39-bb5e-48ab-9308-59217d569493 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:28.669603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699d39-bb5e-48ab-9308-59217d569493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:28.698637 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d2699d39-bb5e-48ab-9308-59217d569493 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:28.699985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d2699d39-bb5e-48ab-9308-59217d569493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:28.769188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1005/1988] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:28.781017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:28.783441 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:28.855210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bc5a6-744b-4c31-9020-5ed84a3aff78 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:28.859651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e73ac-f7cc-4472-b7c6-134ea02acd53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:28.860259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e73ac-f7cc-4472-b7c6-134ea02acd53 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:28.860539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e73ac-f7cc-4472-b7c6-134ea02acd53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:28.860842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e73ac-f7cc-4472-b7c6-134ea02acd53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:28.869947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e73ac-f7cc-4472-b7c6-134ea02acd53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:28.871694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e73ac-f7cc-4472-b7c6-134ea02acd53 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:28.884006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 984/1989] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:29.262234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699d39-bb5e-48ab-9308-59217d569493 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:29.264322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d2699d39-bb5e-48ab-9308-59217d569493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.284923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699d39-bb5e-48ab-9308-59217d569493 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:29.290766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:29.291375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.291657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.291931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] PATH_INFO: `/v3/projects/49c19621e71b4107a2a62ffde5bdabb6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.293068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c19621e71b4107a2a62ffde5bdabb6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:29.295222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:29.343868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c19621e71b4107a2a62ffde5bdabb6', 'request_id': 'req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.350155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c19621e71b4107a2a62ffde5bdabb6', 'request_id': 'req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.359386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c19621e71b4107a2a62ffde5bdabb6', 'request_id': 'req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.370505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] The token cache is being invalidate because project 49c19621e71b4107a2a62ffde5bdabb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:29.370796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.371519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.373025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1006/1990] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:29 2022] DELETE /identity/v3/projects/49c19621e71b4107a2a62ffde5bdabb6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:29.378887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fd50-1137-43f4-9c40-158b4460c2e5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.379317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fd50-1137-43f4-9c40-158b4460c2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.379483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9fd50-1137-43f4-9c40-158b4460c2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.399995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9fd9fd50-1137-43f4-9c40-158b4460c2e5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:29.401208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9fd9fd50-1137-43f4-9c40-158b4460c2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.478701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 985/1991] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:29.483350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:29.485716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.486853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad68e-5ae5-4696-8ccb-45192db502ad None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.487213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad68e-5ae5-4696-8ccb-45192db502ad None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.487691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad68e-5ae5-4696-8ccb-45192db502ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.498788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24138424-0a24-4eb7-b9e2-9ecadfe7bd57 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:29.504399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:29.507524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.507999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.508461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] PATH_INFO: `/v3/users/3bd6ee5b0c524d49bb8f0b6e84d6f26e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.509641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6e7ad68e-5ae5-4696-8ccb-45192db502ad None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:29.510470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd6ee5b0c524d49bb8f0b6e84d6f26e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:29.511327 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6e7ad68e-5ae5-4696-8ccb-45192db502ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.513427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:29.522775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 986/1992] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:29.526683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad68e-5ae5-4696-8ccb-45192db502ad None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:29.546979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad68e-5ae5-4696-8ccb-45192db502ad None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:29.556826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:29.557598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.557914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.558240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.558974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:29.559951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:29.561274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:29.581034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 987/1993] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:29.581739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd6ee5b0c524d49bb8f0b6e84d6f26e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.581952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:29.590293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd6ee5b0c524d49bb8f0b6e84d6f26e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.591161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd6ee5b0c524d49bb8f0b6e84d6f26e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.592718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd6ee5b0c524d49bb8f0b6e84d6f26e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.595349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:29.595654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a3233-c834-425a-bd97-3e9a5e9199cc admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:29.602983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:29.603910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.604193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.604467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.605100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:29.607430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:29.614143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-fc419615-37a1-4bfc-903b-1c73b3c0e8c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd6ee5b0c524d49bb8f0b6e84d6f26e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.632807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1007/1994] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:29 2022] DELETE /identity/v3/users/3bd6ee5b0c524d49bb8f0b6e84d6f26e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:29.637667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac38a3-6ae6-4ed3-83b8-a076ec9c1248 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.637960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac38a3-6ae6-4ed3-83b8-a076ec9c1248 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.638241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac38a3-6ae6-4ed3-83b8-a076ec9c1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.649652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 988/1995] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:29 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:29.655296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:29.660908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.663450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8aac38a3-6ae6-4ed3-83b8-a076ec9c1248 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:29.664709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8aac38a3-6ae6-4ed3-83b8-a076ec9c1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.668599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:29.755470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1008/1996] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:29.757048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac38a3-6ae6-4ed3-83b8-a076ec9c1248 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:29.758396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8aac38a3-6ae6-4ed3-83b8-a076ec9c1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.770774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac38a3-6ae6-4ed3-83b8-a076ec9c1248 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:29.775488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:29.776137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.776419 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.776691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] PATH_INFO: `/v3/users/da387c725330429ab85df21c1821537b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.777897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da387c725330429ab85df21c1821537b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:29.779835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:29.794088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a145-3783-4ab8-a495-67617d71d4b6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:29.801289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:29.801914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.802192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.802464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.803228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:29.806654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:29.831916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 989/1997] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:29 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:29.832935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:29.834600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.844776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da387c725330429ab85df21c1821537b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.855935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da387c725330429ab85df21c1821537b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.856787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da387c725330429ab85df21c1821537b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.857524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da387c725330429ab85df21c1821537b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.878199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da387c725330429ab85df21c1821537b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:29.896331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1009/1998] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:29 2022] DELETE /identity/v3/users/da387c725330429ab85df21c1821537b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:29.897651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:29.899266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:29.913549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab3c21-6d1a-41b6-ac03-edd7b12f7af0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:29.954630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:29.978017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fdc4c-d813-4dba-b1d0-652601e4d542 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:29.983273 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2947d9b-1141-4d48-aa25-29621ed37c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:29.984422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:29.984626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947d9b-1141-4d48-aa25-29621ed37c1b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.984717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947d9b-1141-4d48-aa25-29621ed37c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.984962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2947d9b-1141-4d48-aa25-29621ed37c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.985612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2947d9b-1141-4d48-aa25-29621ed37c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:29.986053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:29.986513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:29.987761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2947d9b-1141-4d48-aa25-29621ed37c1b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:29.988275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:29.990586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.001371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1010/1999] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:30.001371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426aee-43ab-4a34-af5e-7df75792deb5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.001371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426aee-43ab-4a34-af5e-7df75792deb5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.001371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9426aee-43ab-4a34-af5e-7df75792deb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:30.015894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:30.017353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:30.019231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f9426aee-43ab-4a34-af5e-7df75792deb5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:30.020443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f9426aee-43ab-4a34-af5e-7df75792deb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.028445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1011/2000] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:30.029085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9426aee-43ab-4a34-af5e-7df75792deb5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:30.038087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 990/2001] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:30.039260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9426aee-43ab-4a34-af5e-7df75792deb5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:30.040133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:30.043275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.044345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e6e85-d30a-490e-8780-37b7ece31a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:30.045035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6e85-d30a-490e-8780-37b7ece31a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.045547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6e85-d30a-490e-8780-37b7ece31a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.045659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6e85-d30a-490e-8780-37b7ece31a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:30.047299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e6e85-d30a-490e-8780-37b7ece31a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:30.049021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e6e85-d30a-490e-8780-37b7ece31a14 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:30.058428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2702b-e9df-4e95-9301-93bf5a944801 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:30.060200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1012/2002] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:30.065187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e6e85-d30a-490e-8780-37b7ece31a14 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:30.071072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab8fdc-77ec-4b4a-bcae-8447ca9b083f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:30.071703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8fdc-77ec-4b4a-bcae-8447ca9b083f service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.071984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8fdc-77ec-4b4a-bcae-8447ca9b083f service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.072258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8fdc-77ec-4b4a-bcae-8447ca9b083f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:30.079758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e6e85-d30a-490e-8780-37b7ece31a14 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:30.093828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab8fdc-77ec-4b4a-bcae-8447ca9b083f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:30.095475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab8fdc-77ec-4b4a-bcae-8447ca9b083f service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:30.102164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:30.102859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.103181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.103722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] PATH_INFO: `/v3/projects/e15fb7144f5e49da82cf800d7b34c42e/users/403b22eabfbf47b680351ad0884e393e/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:30.107186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 991/2003] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:30.124144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15fb7144f5e49da82cf800d7b34c42e, user_id=403b22eabfbf47b680351ad0884e393e, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:30.128686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:30.145841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1013/2004] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:30 2022] PUT /identity/v3/projects/e15fb7144f5e49da82cf800d7b34c42e/users/403b22eabfbf47b680351ad0884e393e/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:30.158085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecb00-a101-4c67-bf06-79fa64370c9c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.158364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecb00-a101-4c67-bf06-79fa64370c9c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.158639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecb00-a101-4c67-bf06-79fa64370c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:30.189133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f04ecb00-a101-4c67-bf06-79fa64370c9c None None] MFA Rules not processed for user `403b22eabfbf47b680351ad0884e393e`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:30.190386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f04ecb00-a101-4c67-bf06-79fa64370c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.221608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:30.263879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 992/2005] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:30.275896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:30.277668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.355397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516c62d-81c6-4275-b42c-2b04f5fd760c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:30.359667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:30.360301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.360581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.360856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:30.370076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:30.371545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:30.381689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1014/2006] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:30.497118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ecb00-a101-4c67-bf06-79fa64370c9c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:30.498560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f04ecb00-a101-4c67-bf06-79fa64370c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.572853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:30.579971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.637808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ecb00-a101-4c67-bf06-79fa64370c9c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:30.644040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:30.645137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.645399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.645738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] PATH_INFO: `/v3/projects/74cb3426ae37497aa13465fd24439d19` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:30.647296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cb3426ae37497aa13465fd24439d19)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:30.651369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:30.705135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b277e40-3c92-4035-a807-b53df3a96618 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:30.716364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:30.717024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.717346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.717665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] PATH_INFO: `/v3/projects/ccd3edb646ad447da159cb3b08692bef` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:30.720500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd3edb646ad447da159cb3b08692bef)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:30.724395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:30.737641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cb3426ae37497aa13465fd24439d19', 'request_id': 'req-cf0f56f6-268c-4130-8615-0e29cc1e5f80'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.745205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cb3426ae37497aa13465fd24439d19', 'request_id': 'req-cf0f56f6-268c-4130-8615-0e29cc1e5f80'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.760283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cb3426ae37497aa13465fd24439d19', 'request_id': 'req-cf0f56f6-268c-4130-8615-0e29cc1e5f80'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.778608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] The token cache is being invalidate because project 74cb3426ae37497aa13465fd24439d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:30.778608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.778608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.785435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 993/2007] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:30 2022] DELETE /identity/v3/projects/74cb3426ae37497aa13465fd24439d19 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:30.786670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:30.788029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.819089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:30.830884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd3edb646ad447da159cb3b08692bef', 'request_id': 'req-31ccd029-b358-493a-88e2-f26cd5d0e2cb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.847541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd3edb646ad447da159cb3b08692bef', 'request_id': 'req-31ccd029-b358-493a-88e2-f26cd5d0e2cb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.858635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd3edb646ad447da159cb3b08692bef', 'request_id': 'req-31ccd029-b358-493a-88e2-f26cd5d0e2cb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.877504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] The token cache is being invalidate because project ccd3edb646ad447da159cb3b08692bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:30.877999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.879169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:30.881833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1015/2008] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:30 2022] DELETE /identity/v3/projects/ccd3edb646ad447da159cb3b08692bef => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:30.885937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:30.888686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:30.911811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:30.917962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f56f6-268c-4130-8615-0e29cc1e5f80 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:30.987795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccd029-b358-493a-88e2-f26cd5d0e2cb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:30.995961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:30.998053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:30.998496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:30.998772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] PATH_INFO: `/v3/users/ac3c16f45af34ec2ad4dd6df4b537cac` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:31.000275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3c16f45af34ec2ad4dd6df4b537cac)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:31.003502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:31.004646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:31.005592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:31.005879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:31.006754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] PATH_INFO: `/v3/users/84e26ee06ad640af99fc795a3ed9b5a2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:31.008219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e26ee06ad640af99fc795a3ed9b5a2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:31.011344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:31.084117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e26ee06ad640af99fc795a3ed9b5a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.094908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e26ee06ad640af99fc795a3ed9b5a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.095659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e26ee06ad640af99fc795a3ed9b5a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.097355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e26ee06ad640af99fc795a3ed9b5a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.107794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e26ee06ad640af99fc795a3ed9b5a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.141781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3c16f45af34ec2ad4dd6df4b537cac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.147616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 994/2009] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:30 2022] DELETE /identity/v3/users/84e26ee06ad640af99fc795a3ed9b5a2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:31.169450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3c16f45af34ec2ad4dd6df4b537cac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.170372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3c16f45af34ec2ad4dd6df4b537cac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.171792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3c16f45af34ec2ad4dd6df4b537cac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.198168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3c16f45af34ec2ad4dd6df4b537cac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:31.224367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1016/2010] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:30 2022] DELETE /identity/v3/users/ac3c16f45af34ec2ad4dd6df4b537cac => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:31.767664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:31.769743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:31.833967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:31.836068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:31.867574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586c73e-0fdb-417b-87fb-c5b1802c671f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:31.907884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:31.911335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:31.926288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acc15c-ccc0-457b-8302-5331926e77a6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:31.935954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:31.937075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:31.937597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:31.937847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] PATH_INFO: `/v3/projects/f2ff2fb3dfda4ed7b41b70b3e2c88697` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:31.939270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ff2fb3dfda4ed7b41b70b3e2c88697)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:31.941349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:31.957127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:31.957807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:31.958090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:31.958370 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] PATH_INFO: `/v3/projects/87227c034d2842b5b18970c96336f3fa` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:31.960424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87227c034d2842b5b18970c96336f3fa)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:31.962346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.020948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ff2fb3dfda4ed7b41b70b3e2c88697', 'request_id': 'req-7027bc29-19a0-415e-a638-c386302a8feb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.035337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ff2fb3dfda4ed7b41b70b3e2c88697', 'request_id': 'req-7027bc29-19a0-415e-a638-c386302a8feb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.047043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ff2fb3dfda4ed7b41b70b3e2c88697', 'request_id': 'req-7027bc29-19a0-415e-a638-c386302a8feb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.062787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] The token cache is being invalidate because project f2ff2fb3dfda4ed7b41b70b3e2c88697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:32.063689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.064000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.065916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1017/2011] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:31 2022] DELETE /identity/v3/projects/f2ff2fb3dfda4ed7b41b70b3e2c88697 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:32.067169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87227c034d2842b5b18970c96336f3fa', 'request_id': 'req-24d4429b-db1d-4c4f-8db1-8d7c9543d887'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.069657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.071055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:32.074824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87227c034d2842b5b18970c96336f3fa', 'request_id': 'req-24d4429b-db1d-4c4f-8db1-8d7c9543d887'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.084291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87227c034d2842b5b18970c96336f3fa', 'request_id': 'req-24d4429b-db1d-4c4f-8db1-8d7c9543d887'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.099851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] The token cache is being invalidate because project 87227c034d2842b5b18970c96336f3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:32.100271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.101092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-24d4429b-db1d-4c4f-8db1-8d7c9543d887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.106451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 995/2012] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:31 2022] DELETE /identity/v3/projects/87227c034d2842b5b18970c96336f3fa => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:32.108290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840189a3-d62d-4655-ae82-d5e322ce1146 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.109171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840189a3-d62d-4655-ae82-d5e322ce1146 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.109796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840189a3-d62d-4655-ae82-d5e322ce1146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.134725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-840189a3-d62d-4655-ae82-d5e322ce1146 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:32.136537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-840189a3-d62d-4655-ae82-d5e322ce1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:32.179274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027bc29-19a0-415e-a638-c386302a8feb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:32.233072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 996/2013] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:32.241756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1a62-a1f9-4ab7-a6a0-d976c97ebc93 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.242216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1a62-a1f9-4ab7-a6a0-d976c97ebc93 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.242605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a1a62-a1f9-4ab7-a6a0-d976c97ebc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.266758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f91a1a62-a1f9-4ab7-a6a0-d976c97ebc93 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:32.267600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f91a1a62-a1f9-4ab7-a6a0-d976c97ebc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:32.276978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 997/2014] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:32.281263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a1a62-a1f9-4ab7-a6a0-d976c97ebc93 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.290573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a1a62-a1f9-4ab7-a6a0-d976c97ebc93 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:32.291439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:32.292165 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.292450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.292731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] PATH_INFO: `/v3/users/e0f270d82b2d4070980ef5b6f1815b2f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.293931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f270d82b2d4070980ef5b6f1815b2f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:32.295325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:32.296466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.296591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.296746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.297076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.297727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:32.298033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:32.299660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.311415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 998/2015] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:19:32.316359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.327542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5d2e5-411c-4802-a714-42797a12dc3b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:32.333051 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:32.333229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:32.333944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.334273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.334649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.335300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:32.337666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.350259 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f270d82b2d4070980ef5b6f1815b2f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.357970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f270d82b2d4070980ef5b6f1815b2f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.359434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f270d82b2d4070980ef5b6f1815b2f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.360266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f270d82b2d4070980ef5b6f1815b2f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.369668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 999/2016] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:32 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:32.373796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.376185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f270d82b2d4070980ef5b6f1815b2f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:32.376304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:32.391353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1018/2017] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:32 2022] DELETE /identity/v3/users/e0f270d82b2d4070980ef5b6f1815b2f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:32.398349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:32.445306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40576d88-dfc3-4bd0-a90a-4bf87b665bfa admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:32.510164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239614ae-3ad4-4028-9640-03da1e0c7f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:32.511043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239614ae-3ad4-4028-9640-03da1e0c7f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.511228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239614ae-3ad4-4028-9640-03da1e0c7f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.511569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239614ae-3ad4-4028-9640-03da1e0c7f77 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.512277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239614ae-3ad4-4028-9640-03da1e0c7f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:32.514280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239614ae-3ad4-4028-9640-03da1e0c7f77 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.538228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1000/2018] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:32 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:32.542443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.555251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5013ad7-be3f-4c3d-968b-4b36ff10f632 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:32.563808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435cda7-cc23-4d7a-999b-e125d12b9109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:32.564535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435cda7-cc23-4d7a-999b-e125d12b9109 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.564884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435cda7-cc23-4d7a-999b-e125d12b9109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.565237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6435cda7-cc23-4d7a-999b-e125d12b9109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.565997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435cda7-cc23-4d7a-999b-e125d12b9109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:32.568656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6435cda7-cc23-4d7a-999b-e125d12b9109 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.581686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1019/2019] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:32.585424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239614ae-3ad4-4028-9640-03da1e0c7f77 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.602057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239614ae-3ad4-4028-9640-03da1e0c7f77 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:32.607312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc95f88-2493-4722-b313-6632d5849cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:32.608475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95f88-2493-4722-b313-6632d5849cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.609291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95f88-2493-4722-b313-6632d5849cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.610041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc95f88-2493-4722-b313-6632d5849cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.610792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc95f88-2493-4722-b313-6632d5849cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:32.612629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc95f88-2493-4722-b313-6632d5849cf3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.628114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1001/2020] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:32.629684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435cda7-cc23-4d7a-999b-e125d12b9109 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.641024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6435cda7-cc23-4d7a-999b-e125d12b9109 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:32.646380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65d688-c1f3-4941-987a-f874419986fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:32.647419 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65d688-c1f3-4941-987a-f874419986fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.648151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65d688-c1f3-4941-987a-f874419986fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.648754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65d688-c1f3-4941-987a-f874419986fe admin admin] PATH_INFO: `/v3/projects/2cc39332d5f54557ba0af2d8583f2518/users/6bf28c259913407796ffb3466b8874a4/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.665906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65d688-c1f3-4941-987a-f874419986fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc39332d5f54557ba0af2d8583f2518, user_id=6bf28c259913407796ffb3466b8874a4, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:32.669185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65d688-c1f3-4941-987a-f874419986fe admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.695716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1020/2021] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:32 2022] PUT /identity/v3/projects/2cc39332d5f54557ba0af2d8583f2518/users/6bf28c259913407796ffb3466b8874a4/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:32.701302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb890f-4b15-4237-958e-3ba2f7237b36 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.701802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb890f-4b15-4237-958e-3ba2f7237b36 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.702873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb890f-4b15-4237-958e-3ba2f7237b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.754702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a3eb890f-4b15-4237-958e-3ba2f7237b36 None None] MFA Rules not processed for user `6bf28c259913407796ffb3466b8874a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:32.756074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a3eb890f-4b15-4237-958e-3ba2f7237b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:32.849610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1002/2022] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:32.854115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65d688-c1f3-4941-987a-f874419986fe admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.926356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65d688-c1f3-4941-987a-f874419986fe admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:32.931828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:32.933285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:32.933682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:32.934003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:32.934708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:32.936932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:32.972953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1021/2023] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:32 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:32.973587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb890f-4b15-4237-958e-3ba2f7237b36 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.973877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:32.976065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:32.997859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb890f-4b15-4237-958e-3ba2f7237b36 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.050732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:33.067312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:33.080330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe87e0-f3f5-4184-8cd3-1f5b3e81d4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.080619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aca37-3a8f-4378-b516-8fb4f8078bd0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.081221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe87e0-f3f5-4184-8cd3-1f5b3e81d4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.081599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe87e0-f3f5-4184-8cd3-1f5b3e81d4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.081948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe87e0-f3f5-4184-8cd3-1f5b3e81d4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.082667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe87e0-f3f5-4184-8cd3-1f5b3e81d4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.084729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe87e0-f3f5-4184-8cd3-1f5b3e81d4f6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.089136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.090388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.091100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.091461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] PATH_INFO: `/v3/projects/4972aa0cf1584573a9e2e75edcac99ac` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.093142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4972aa0cf1584573a9e2e75edcac99ac)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.095326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.122196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1003/2024] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:32 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:33.125313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe87e0-f3f5-4184-8cd3-1f5b3e81d4f6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.141834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe87e0-f3f5-4184-8cd3-1f5b3e81d4f6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.149428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59649-74a6-4ca4-8991-8371ac58a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.150412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59649-74a6-4ca4-8991-8371ac58a611 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.150906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59649-74a6-4ca4-8991-8371ac58a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.151601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59649-74a6-4ca4-8991-8371ac58a611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.153253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59649-74a6-4ca4-8991-8371ac58a611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.156577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59649-74a6-4ca4-8991-8371ac58a611 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.162708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4972aa0cf1584573a9e2e75edcac99ac', 'request_id': 'req-8611fbe3-d506-421c-ab28-24e3c63c5f6a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:33.170574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4972aa0cf1584573a9e2e75edcac99ac', 'request_id': 'req-8611fbe3-d506-421c-ab28-24e3c63c5f6a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:33.173163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1004/2025] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:33.173971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59649-74a6-4ca4-8991-8371ac58a611 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.183515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4972aa0cf1584573a9e2e75edcac99ac', 'request_id': 'req-8611fbe3-d506-421c-ab28-24e3c63c5f6a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:33.194350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59649-74a6-4ca4-8991-8371ac58a611 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.202207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] The token cache is being invalidate because project 4972aa0cf1584573a9e2e75edcac99ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:33.202933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:33.204012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-8611fbe3-d506-421c-ab28-24e3c63c5f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:33.205685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1022/2026] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:32 2022] DELETE /identity/v3/projects/4972aa0cf1584573a9e2e75edcac99ac => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:33.210303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b47fd-05b7-407b-b100-381bbcb97f1a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.210596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b47fd-05b7-407b-b100-381bbcb97f1a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.210875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b47fd-05b7-407b-b100-381bbcb97f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.231894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7a5b47fd-05b7-407b-b100-381bbcb97f1a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:33.233106 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7a5b47fd-05b7-407b-b100-381bbcb97f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:33.257414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.258176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.258532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.258888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] PATH_INFO: `/v3/projects/a329bf02435843f0be1dfbd8ddc0bf19/users/ff211511d99040eca08e9ab8af3914b7/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.275117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a329bf02435843f0be1dfbd8ddc0bf19, user_id=ff211511d99040eca08e9ab8af3914b7, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.278088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.299479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1005/2027] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:33 2022] PUT /identity/v3/projects/a329bf02435843f0be1dfbd8ddc0bf19/users/ff211511d99040eca08e9ab8af3914b7/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:33.303714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.305491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:33.305963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1023/2028] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:33.316388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed983d5-cec7-4247-95fb-9c11fc66788a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.317090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed983d5-cec7-4247-95fb-9c11fc66788a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.317553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed983d5-cec7-4247-95fb-9c11fc66788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.354292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fed983d5-cec7-4247-95fb-9c11fc66788a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:33.355976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fed983d5-cec7-4247-95fb-9c11fc66788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:33.414241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0229d-5b84-4fe2-aaf0-827d9297643a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.433358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7bf81-6bf8-4667-9b02-dfe53abad537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.434089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7bf81-6bf8-4667-9b02-dfe53abad537 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.434454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7bf81-6bf8-4667-9b02-dfe53abad537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.434811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7bf81-6bf8-4667-9b02-dfe53abad537 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.436260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7bf81-6bf8-4667-9b02-dfe53abad537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.441829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7bf81-6bf8-4667-9b02-dfe53abad537 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.461938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1006/2029] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:33.466955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7bf81-6bf8-4667-9b02-dfe53abad537 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.480251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1024/2030] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:33.487776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed983d5-cec7-4247-95fb-9c11fc66788a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.491907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7bf81-6bf8-4667-9b02-dfe53abad537 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.498402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb8bce-045e-4121-9e61-9826265b118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.499955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8bce-045e-4121-9e61-9826265b118f admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.500243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8bce-045e-4121-9e61-9826265b118f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.500523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb8bce-045e-4121-9e61-9826265b118f admin admin] PATH_INFO: `/v3/projects/a329bf02435843f0be1dfbd8ddc0bf19/users/ff211511d99040eca08e9ab8af3914b7/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.503253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8bce-045e-4121-9e61-9826265b118f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a329bf02435843f0be1dfbd8ddc0bf19, user_id=ff211511d99040eca08e9ab8af3914b7, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.507787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb8bce-045e-4121-9e61-9826265b118f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.523361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1007/2031] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:33 2022] PUT /identity/v3/projects/a329bf02435843f0be1dfbd8ddc0bf19/users/ff211511d99040eca08e9ab8af3914b7/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:33.528486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed983d5-cec7-4247-95fb-9c11fc66788a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.535717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3f75-451a-4b8e-831f-223432b9fbc1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.536513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3f75-451a-4b8e-831f-223432b9fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.537027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c3f75-451a-4b8e-831f-223432b9fbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.586694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f85c3f75-451a-4b8e-831f-223432b9fbc1 None None] MFA Rules not processed for user `ff211511d99040eca08e9ab8af3914b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:33.587990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f85c3f75-451a-4b8e-831f-223432b9fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:33.598602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:33.601714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:33.663040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.664054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.664493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.664738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.665508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:33.665940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.667988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.687470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1025/2032] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:33.691948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.708804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753cce5-1f18-40ee-9f15-719caff4e133 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.710233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1008/2033] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:33.720417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439281d-0302-4e89-831b-6e91805315c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.721590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439281d-0302-4e89-831b-6e91805315c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.721947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439281d-0302-4e89-831b-6e91805315c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.722392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439281d-0302-4e89-831b-6e91805315c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.723275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439281d-0302-4e89-831b-6e91805315c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.726437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439281d-0302-4e89-831b-6e91805315c8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.727168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c3f75-451a-4b8e-831f-223432b9fbc1 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.728593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f85c3f75-451a-4b8e-831f-223432b9fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:33.766261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1026/2034] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:33 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:33.767441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439281d-0302-4e89-831b-6e91805315c8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.802648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c3f75-451a-4b8e-831f-223432b9fbc1 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.873413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439281d-0302-4e89-831b-6e91805315c8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.878805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56420444-315b-4326-8ea9-337b6bd15982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.879611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420444-315b-4326-8ea9-337b6bd15982 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.880061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420444-315b-4326-8ea9-337b6bd15982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.880342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56420444-315b-4326-8ea9-337b6bd15982 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.881130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56420444-315b-4326-8ea9-337b6bd15982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.882241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b99d1-ece5-4392-8044-4f55625f6358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.883219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56420444-315b-4326-8ea9-337b6bd15982 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.883647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b99d1-ece5-4392-8044-4f55625f6358 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.884078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b99d1-ece5-4392-8044-4f55625f6358 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.884500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b99d1-ece5-4392-8044-4f55625f6358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.920318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1027/2035] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:33 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:33.932524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56420444-315b-4326-8ea9-337b6bd15982 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:33.964320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b99d1-ece5-4392-8044-4f55625f6358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.965959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b99d1-ece5-4392-8044-4f55625f6358 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:33.974159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56420444-315b-4326-8ea9-337b6bd15982 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:33.978695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1009/2036] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:33.981106 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c8bc-cd48-4e0c-b7e7-91a109df2410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:33.981739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c8bc-cd48-4e0c-b7e7-91a109df2410 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:33.982024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c8bc-cd48-4e0c-b7e7-91a109df2410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:33.982299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336c8bc-cd48-4e0c-b7e7-91a109df2410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:33.982962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c8bc-cd48-4e0c-b7e7-91a109df2410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:33.985331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336c8bc-cd48-4e0c-b7e7-91a109df2410 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.003676 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1028/2037] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:34.013336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b99d1-ece5-4392-8044-4f55625f6358 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.033740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b99d1-ece5-4392-8044-4f55625f6358 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.043921 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6a8ba-b4c8-4964-aa0e-ec6da3abb6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.049776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a8ba-b4c8-4964-aa0e-ec6da3abb6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.049776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a8ba-b4c8-4964-aa0e-ec6da3abb6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.049776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6a8ba-b4c8-4964-aa0e-ec6da3abb6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.049776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6a8ba-b4c8-4964-aa0e-ec6da3abb6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.049776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6a8ba-b4c8-4964-aa0e-ec6da3abb6e8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.057002 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:34.070125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1010/2038] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:34.070226 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c8bc-cd48-4e0c-b7e7-91a109df2410 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.085472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336c8bc-cd48-4e0c-b7e7-91a109df2410 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.100293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aef8d-defa-452c-8bb9-5f2594a266cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.101005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aef8d-defa-452c-8bb9-5f2594a266cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.101293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aef8d-defa-452c-8bb9-5f2594a266cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.101626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9aef8d-defa-452c-8bb9-5f2594a266cf admin admin] PATH_INFO: `/v3/projects/8388427d8d1e4e63a3782b9dc97b188e/users/bd4ac6f9d7a24597969024028aacff0b/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.134228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aef8d-defa-452c-8bb9-5f2594a266cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8388427d8d1e4e63a3782b9dc97b188e, user_id=bd4ac6f9d7a24597969024028aacff0b, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.139354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9aef8d-defa-452c-8bb9-5f2594a266cf admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.158765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1029/2039] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:34 2022] PUT /identity/v3/projects/8388427d8d1e4e63a3782b9dc97b188e/users/bd4ac6f9d7a24597969024028aacff0b/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:34.169851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d6427-40c5-44fd-a658-d3715640867e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.170145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d6427-40c5-44fd-a658-d3715640867e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.170492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d6427-40c5-44fd-a658-d3715640867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.240258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-615d6427-40c5-44fd-a658-d3715640867e None None] MFA Rules not processed for user `bd4ac6f9d7a24597969024028aacff0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:34.241409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-615d6427-40c5-44fd-a658-d3715640867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:34.357252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1011/2040] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:34.363989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aef8d-defa-452c-8bb9-5f2594a266cf admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.461496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:34.469258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9aef8d-defa-452c-8bb9-5f2594a266cf admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.475020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f1a4b-70fd-49f0-99fa-5ec043bc1179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.475785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f1a4b-70fd-49f0-99fa-5ec043bc1179 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.476062 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f1a4b-70fd-49f0-99fa-5ec043bc1179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.476361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f1a4b-70fd-49f0-99fa-5ec043bc1179 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.476993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f1a4b-70fd-49f0-99fa-5ec043bc1179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.478920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f1a4b-70fd-49f0-99fa-5ec043bc1179 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.511079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1030/2041] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:34 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:34.514085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d6427-40c5-44fd-a658-d3715640867e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.522395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f1a4b-70fd-49f0-99fa-5ec043bc1179 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.530825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d6427-40c5-44fd-a658-d3715640867e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.588773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f1a4b-70fd-49f0-99fa-5ec043bc1179 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.592185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dc664-b55f-4878-beac-55d5c050fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.592852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dc664-b55f-4878-beac-55d5c050fc72 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.593340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dc664-b55f-4878-beac-55d5c050fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.594395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.594617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507dc664-b55f-4878-beac-55d5c050fc72 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.595063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.595340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dc664-b55f-4878-beac-55d5c050fc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.595451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.595614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] PATH_INFO: `/v3/users/6bf28c259913407796ffb3466b8874a4` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.597003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf28c259913407796ffb3466b8874a4)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.597793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507dc664-b55f-4878-beac-55d5c050fc72 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.598912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.622872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1012/2042] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:34 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:34.627805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dc664-b55f-4878-beac-55d5c050fc72 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.637851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507dc664-b55f-4878-beac-55d5c050fc72 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.643463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff9533-c687-465c-9dc3-08d30ff931bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.644077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff9533-c687-465c-9dc3-08d30ff931bf admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.644364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff9533-c687-465c-9dc3-08d30ff931bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.644643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff9533-c687-465c-9dc3-08d30ff931bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.645325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff9533-c687-465c-9dc3-08d30ff931bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.646892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff9533-c687-465c-9dc3-08d30ff931bf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.659345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1013/2043] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:34.659501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf28c259913407796ffb3466b8874a4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:34.663154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff9533-c687-465c-9dc3-08d30ff931bf admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.670060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf28c259913407796ffb3466b8874a4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:34.670680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf28c259913407796ffb3466b8874a4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:34.673040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf28c259913407796ffb3466b8874a4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:34.675420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff9533-c687-465c-9dc3-08d30ff931bf admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.681301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.682004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.682719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.683027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.683684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.685272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.687350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-771de955-0918-4b53-9650-dd75914a1440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf28c259913407796ffb3466b8874a4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:34.699181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1014/2044] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:34.702194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1031/2045] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:34 2022] DELETE /identity/v3/users/6bf28c259913407796ffb3466b8874a4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:34.705264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.707800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75c24-fa27-45ed-bd9d-116c3276edcf None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.708086 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75c24-fa27-45ed-bd9d-116c3276edcf None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.708361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f75c24-fa27-45ed-bd9d-116c3276edcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.709894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:34.724299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1dd74f-fae4-46b0-b143-abcec785cbc0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.732344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-83f75c24-fa27-45ed-bd9d-116c3276edcf None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:34.734261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-83f75c24-fa27-45ed-bd9d-116c3276edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:34.792182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:34.793076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:34.800961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b3b0f-42e6-4dc4-82fa-79461ece9111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.801745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b3b0f-42e6-4dc4-82fa-79461ece9111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.802154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b3b0f-42e6-4dc4-82fa-79461ece9111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.802561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b3b0f-42e6-4dc4-82fa-79461ece9111 admin admin] PATH_INFO: `/v3/projects/fa177c5adab442b8a02069c90526f1e6/users/5b3747d06706434e87c99c57fb8f8115/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.807065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1032/2046] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:34.814428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75c24-fa27-45ed-bd9d-116c3276edcf None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:34.815847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-83f75c24-fa27-45ed-bd9d-116c3276edcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:34.819054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b3b0f-42e6-4dc4-82fa-79461ece9111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa177c5adab442b8a02069c90526f1e6, user_id=5b3747d06706434e87c99c57fb8f8115, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:34.821749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b3b0f-42e6-4dc4-82fa-79461ece9111 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:34.834955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1015/2047] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:34 2022] PUT /identity/v3/projects/fa177c5adab442b8a02069c90526f1e6/users/5b3747d06706434e87c99c57fb8f8115/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:34.845464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8f10-951e-4835-8d1a-61c3e72f42ee None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.845834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8f10-951e-4835-8d1a-61c3e72f42ee None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.846038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff8f10-951e-4835-8d1a-61c3e72f42ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.877527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-adff8f10-951e-4835-8d1a-61c3e72f42ee None None] MFA Rules not processed for user `5b3747d06706434e87c99c57fb8f8115`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:34.879106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-adff8f10-951e-4835-8d1a-61c3e72f42ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:34.879250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f75c24-fa27-45ed-bd9d-116c3276edcf None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:34.933413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866f84b-540d-4148-b915-adfef1e1968b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:34.934025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866f84b-540d-4148-b915-adfef1e1968b service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:34.934307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866f84b-540d-4148-b915-adfef1e1968b service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:34.934584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866f84b-540d-4148-b915-adfef1e1968b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:34.949354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1016/2048] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:34.953921 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff8f10-951e-4835-8d1a-61c3e72f42ee None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.004807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866f84b-540d-4148-b915-adfef1e1968b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.006261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866f84b-540d-4148-b915-adfef1e1968b service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.017306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1033/2049] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:35.018862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff8f10-951e-4835-8d1a-61c3e72f42ee None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.023558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34536f-1279-42f9-8795-54df12c8c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.024184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34536f-1279-42f9-8795-54df12c8c661 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.024594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34536f-1279-42f9-8795-54df12c8c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.024933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34536f-1279-42f9-8795-54df12c8c661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.025572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34536f-1279-42f9-8795-54df12c8c661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.027508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34536f-1279-42f9-8795-54df12c8c661 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.059583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1017/2050] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:34 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:35.064677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866f84b-540d-4148-b915-adfef1e1968b service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.077910 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866f84b-540d-4148-b915-adfef1e1968b service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.156251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c9122-ced3-4748-9dcb-3cc0e5bacb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.156897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c9122-ced3-4748-9dcb-3cc0e5bacb20 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.157184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c9122-ced3-4748-9dcb-3cc0e5bacb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.157457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c9122-ced3-4748-9dcb-3cc0e5bacb20 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.158091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c9122-ced3-4748-9dcb-3cc0e5bacb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.160122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c9122-ced3-4748-9dcb-3cc0e5bacb20 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.173768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:35.185305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1034/2051] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:35 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:35.189804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34536f-1279-42f9-8795-54df12c8c661 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.201789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34536f-1279-42f9-8795-54df12c8c661 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.207145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df645801-3901-486c-a6c3-aa54752e3598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.207750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645801-3901-486c-a6c3-aa54752e3598 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.208064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645801-3901-486c-a6c3-aa54752e3598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.208414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df645801-3901-486c-a6c3-aa54752e3598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.209061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df645801-3901-486c-a6c3-aa54752e3598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.210642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df645801-3901-486c-a6c3-aa54752e3598 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.222584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1018/2052] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:35.226590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c9122-ced3-4748-9dcb-3cc0e5bacb20 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.238200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c9122-ced3-4748-9dcb-3cc0e5bacb20 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.254536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.254930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.255255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.255535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] PATH_INFO: `/v3/projects/f3b6357a1ff143f2b78f0fd9da52cdfa/users/09ef67b3cc7949a580e20b2b83c3feda/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.276530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b6357a1ff143f2b78f0fd9da52cdfa, user_id=09ef67b3cc7949a580e20b2b83c3feda, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.279340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.299337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1035/2053] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:35 2022] PUT /identity/v3/projects/f3b6357a1ff143f2b78f0fd9da52cdfa/users/09ef67b3cc7949a580e20b2b83c3feda/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:35.300249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df645801-3901-486c-a6c3-aa54752e3598 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.310749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df645801-3901-486c-a6c3-aa54752e3598 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.384864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:35.397881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.399962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:35.405616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdceedb-4240-4b27-bd1d-edf7e6faf5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.406467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdceedb-4240-4b27-bd1d-edf7e6faf5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.407048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdceedb-4240-4b27-bd1d-edf7e6faf5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.407634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdceedb-4240-4b27-bd1d-edf7e6faf5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.408584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdceedb-4240-4b27-bd1d-edf7e6faf5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.411046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdceedb-4240-4b27-bd1d-edf7e6faf5ad admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.424914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd17a-0792-4ec6-a6ac-afb069f96888 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.425659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1019/2054] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:35.433468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdceedb-4240-4b27-bd1d-edf7e6faf5ad admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.444802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.445509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.445509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.445844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] PATH_INFO: `/v3/projects/2cc39332d5f54557ba0af2d8583f2518` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.448420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc39332d5f54557ba0af2d8583f2518)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.451460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.454851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdceedb-4240-4b27-bd1d-edf7e6faf5ad admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.463779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca98d7-3142-4c4a-9caa-28248a6c8256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.463779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca98d7-3142-4c4a-9caa-28248a6c8256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.463779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca98d7-3142-4c4a-9caa-28248a6c8256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.463779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca98d7-3142-4c4a-9caa-28248a6c8256 admin admin] PATH_INFO: `/v3/projects/f3b6357a1ff143f2b78f0fd9da52cdfa/users/09ef67b3cc7949a580e20b2b83c3feda/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.464085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca98d7-3142-4c4a-9caa-28248a6c8256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b6357a1ff143f2b78f0fd9da52cdfa, user_id=09ef67b3cc7949a580e20b2b83c3feda, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.467306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca98d7-3142-4c4a-9caa-28248a6c8256 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.493082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1020/2055] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:35 2022] PUT /identity/v3/projects/f3b6357a1ff143f2b78f0fd9da52cdfa/users/09ef67b3cc7949a580e20b2b83c3feda/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:35.507664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a3245-bf0e-4caa-ad83-b303d6f70be6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.508528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a3245-bf0e-4caa-ad83-b303d6f70be6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.508528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a3245-bf0e-4caa-ad83-b303d6f70be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.542066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e42a3245-bf0e-4caa-ad83-b303d6f70be6 None None] MFA Rules not processed for user `09ef67b3cc7949a580e20b2b83c3feda`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:35.543937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e42a3245-bf0e-4caa-ad83-b303d6f70be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:35.570413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc39332d5f54557ba0af2d8583f2518', 'request_id': 'req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.584433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc39332d5f54557ba0af2d8583f2518', 'request_id': 'req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.619759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc39332d5f54557ba0af2d8583f2518', 'request_id': 'req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.642257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] The token cache is being invalidate because project 2cc39332d5f54557ba0af2d8583f2518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:35.642559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.644188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.654302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1036/2056] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:35 2022] DELETE /identity/v3/projects/2cc39332d5f54557ba0af2d8583f2518 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:35.656197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.657681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:35.659323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1021/2057] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:35.674780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a3245-bf0e-4caa-ad83-b303d6f70be6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:35.684740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e42a3245-bf0e-4caa-ad83-b303d6f70be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:35.770131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7fc20-5d7c-4974-8ee4-5e28156fd7d9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.770289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a3245-bf0e-4caa-ad83-b303d6f70be6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:35.775590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.775835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:35.776377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.776487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:35.776725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.776838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:35.777140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.777246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] PATH_INFO: `/v3/users/ff211511d99040eca08e9ab8af3914b7` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:35.778360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff211511d99040eca08e9ab8af3914b7)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.779219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:35.780751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.848066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff211511d99040eca08e9ab8af3914b7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.854296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:35.855992 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff211511d99040eca08e9ab8af3914b7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.856132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:35.857052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff211511d99040eca08e9ab8af3914b7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.857782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff211511d99040eca08e9ab8af3914b7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.860656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:35.867596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1022/2058] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:35.874702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ee436d78-63d8-4888-941f-c913ddf73b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff211511d99040eca08e9ab8af3914b7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:35.890414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1037/2059] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:35 2022] DELETE /identity/v3/users/ff211511d99040eca08e9ab8af3914b7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:36.251096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:36.276044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f18b-1426-408f-8a8d-2e036c90bbd8 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:36.310367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:36.400299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:36.400954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.401238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.401521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] PATH_INFO: `/v3/projects/a329bf02435843f0be1dfbd8ddc0bf19` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.402660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a329bf02435843f0be1dfbd8ddc0bf19)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:36.404608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:36.466572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a329bf02435843f0be1dfbd8ddc0bf19', 'request_id': 'req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.473863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a329bf02435843f0be1dfbd8ddc0bf19', 'request_id': 'req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.482094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a329bf02435843f0be1dfbd8ddc0bf19', 'request_id': 'req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.494873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] The token cache is being invalidate because project a329bf02435843f0be1dfbd8ddc0bf19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:36.495203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.495931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8abec4ff-81fc-4570-bd48-5ba6f74d13ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.497449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1023/2060] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:36 2022] DELETE /identity/v3/projects/a329bf02435843f0be1dfbd8ddc0bf19 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:36.502625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f306-88de-41dd-8648-0b1b23f3e6a9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.502946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f306-88de-41dd-8648-0b1b23f3e6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.503525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f306-88de-41dd-8648-0b1b23f3e6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.529551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2b50f306-88de-41dd-8648-0b1b23f3e6a9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:36.531652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2b50f306-88de-41dd-8648-0b1b23f3e6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:36.604804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1038/2061] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:36.614716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797118a3-eefb-42e6-9092-a7ffa29be555 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.615427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797118a3-eefb-42e6-9092-a7ffa29be555 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.615569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797118a3-eefb-42e6-9092-a7ffa29be555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.636300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-797118a3-eefb-42e6-9092-a7ffa29be555 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:36.637543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-797118a3-eefb-42e6-9092-a7ffa29be555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:36.646323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1024/2062] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:36.650403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50f306-88de-41dd-8648-0b1b23f3e6a9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:36.660478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50f306-88de-41dd-8648-0b1b23f3e6a9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:36.666308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:36.666928 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.667251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.667544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.668181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:36.668486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:36.670210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:36.684989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1039/2063] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:36.691252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797118a3-eefb-42e6-9092-a7ffa29be555 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:36.701700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797118a3-eefb-42e6-9092-a7ffa29be555 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:36.714150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729ab34-32ec-454f-9466-617a0edd6a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:36.714779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729ab34-32ec-454f-9466-617a0edd6a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.715094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729ab34-32ec-454f-9466-617a0edd6a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.715378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729ab34-32ec-454f-9466-617a0edd6a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.716031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729ab34-32ec-454f-9466-617a0edd6a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:36.718497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729ab34-32ec-454f-9466-617a0edd6a1b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:36.725732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:36.727969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:36.746598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720ec90-e8d2-4356-963a-f65d327b4c7f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:36.753004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:36.753769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.754060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.754836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] PATH_INFO: `/v3/users/403b22eabfbf47b680351ad0884e393e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.756266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1025/2064] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:36 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:36.756571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=403b22eabfbf47b680351ad0884e393e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:36.758557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:36.760483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729ab34-32ec-454f-9466-617a0edd6a1b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:36.839209 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403b22eabfbf47b680351ad0884e393e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.852914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403b22eabfbf47b680351ad0884e393e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.853861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403b22eabfbf47b680351ad0884e393e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.854871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403b22eabfbf47b680351ad0884e393e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.879980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729ab34-32ec-454f-9466-617a0edd6a1b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:36.885638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:36.886284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.886568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.886847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.887601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:36.889773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:36.899623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b73b91c-63e1-4603-9ebd-11054c7361ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403b22eabfbf47b680351ad0884e393e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:36.916814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:36.928596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1026/2065] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:36 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:36.930481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:36.930728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1040/2066] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:36 2022] DELETE /identity/v3/users/403b22eabfbf47b680351ad0884e393e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:36.936969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:36.938125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300bea4-dd65-43cc-9582-2bedb5ce14c0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:36.938898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300bea4-dd65-43cc-9582-2bedb5ce14c0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:36.939345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300bea4-dd65-43cc-9582-2bedb5ce14c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:36.958108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944a2e-8150-49c2-bf32-f3f9667c567b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:36.963152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f300bea4-dd65-43cc-9582-2bedb5ce14c0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:36.965548 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f300bea4-dd65-43cc-9582-2bedb5ce14c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.014124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:37.081414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.082049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.082410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.082622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.083294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.084903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:37.093500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1041/2067] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:37.099437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1027/2068] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:37.101146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:37.101283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300bea4-dd65-43cc-9582-2bedb5ce14c0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:37.102935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.112075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300bea4-dd65-43cc-9582-2bedb5ce14c0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:37.117871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4fd1-a75c-4494-ba9b-16f54a9bbc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.118486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4fd1-a75c-4494-ba9b-16f54a9bbc22 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.118766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4fd1-a75c-4494-ba9b-16f54a9bbc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.119304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4fd1-a75c-4494-ba9b-16f54a9bbc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.120236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b4fd1-a75c-4494-ba9b-16f54a9bbc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.121996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b4fd1-a75c-4494-ba9b-16f54a9bbc22 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:37.137306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1042/2069] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:37.139155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4fd1-a75c-4494-ba9b-16f54a9bbc22 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:37.151214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4fd1-a75c-4494-ba9b-16f54a9bbc22 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:37.157260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c6b77-65ad-4a90-b710-b62004dff1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.158094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6b77-65ad-4a90-b710-b62004dff1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.158447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6b77-65ad-4a90-b710-b62004dff1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.158730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c6b77-65ad-4a90-b710-b62004dff1a5 admin admin] PATH_INFO: `/v3/projects/a27e4b257a754e8e8988545f4d4b8f85/users/cf22f91633b647249af8661c54fc52e5/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.169843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4f069-6114-4a34-86f9-3f5ea22f7b71 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:37.175211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.175990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.176244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c6b77-65ad-4a90-b710-b62004dff1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27e4b257a754e8e8988545f4d4b8f85, user_id=cf22f91633b647249af8661c54fc52e5, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.176354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.176704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.178922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c6b77-65ad-4a90-b710-b62004dff1a5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:37.189074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.191044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:37.196759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1043/2070] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:37 2022] PUT /identity/v3/projects/a27e4b257a754e8e8988545f4d4b8f85/users/cf22f91633b647249af8661c54fc52e5/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:37.203142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1028/2071] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:37.208675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d2a9b-53c5-479e-a5d3-a5dd64266422 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.208983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d2a9b-53c5-479e-a5d3-a5dd64266422 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.209256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d2a9b-53c5-479e-a5d3-a5dd64266422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.244049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-db7d2a9b-53c5-479e-a5d3-a5dd64266422 None None] MFA Rules not processed for user `cf22f91633b647249af8661c54fc52e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:37.245399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-db7d2a9b-53c5-479e-a5d3-a5dd64266422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.369329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1044/2072] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:37.395983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:37.397439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.524719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f5e69-ca26-4eb8-891e-87e1f0d9ee62 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:37.642754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.644227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.645123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.645909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.646707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d2a9b-53c5-479e-a5d3-a5dd64266422 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:37.648241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-db7d2a9b-53c5-479e-a5d3-a5dd64266422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.653510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:37.659806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.661615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d2a9b-53c5-479e-a5d3-a5dd64266422 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:37.662727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:37.665759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.666616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.667136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.667615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.669907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.687078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1029/2073] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:37.688630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:37.691784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:37.747471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.749088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:37.770119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1045/2074] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:37.770668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:37.852530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:37.898740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67e64d-fe69-4224-90d2-dc01dbeebad1 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:37.911921 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.912683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.913409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.913409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] PATH_INFO: `/v3/projects/e15fb7144f5e49da82cf800d7b34c42e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.914631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15fb7144f5e49da82cf800d7b34c42e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.915872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5c3d1-8454-4022-b8c7-7a362ab3bbcd service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:37.916877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:37.924591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:37.925543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:37.926174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:37.926831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] PATH_INFO: `/v3/users/cf22f91633b647249af8661c54fc52e5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:37.929024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf22f91633b647249af8661c54fc52e5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:37.931744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.016920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15fb7144f5e49da82cf800d7b34c42e', 'request_id': 'req-f67779bf-6e19-412a-acaf-eb36f93634c1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.029030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15fb7144f5e49da82cf800d7b34c42e', 'request_id': 'req-f67779bf-6e19-412a-acaf-eb36f93634c1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.043118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf22f91633b647249af8661c54fc52e5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.049974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15fb7144f5e49da82cf800d7b34c42e', 'request_id': 'req-f67779bf-6e19-412a-acaf-eb36f93634c1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.064151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf22f91633b647249af8661c54fc52e5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.064829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf22f91633b647249af8661c54fc52e5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.065458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf22f91633b647249af8661c54fc52e5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.085301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] The token cache is being invalidate because project e15fb7144f5e49da82cf800d7b34c42e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:38.087818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.089075 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f67779bf-6e19-412a-acaf-eb36f93634c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.092392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1030/2075] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:37 2022] DELETE /identity/v3/projects/e15fb7144f5e49da82cf800d7b34c42e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:38.099143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433383-3801-4679-b06e-bf1cef7bceb3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.099504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433383-3801-4679-b06e-bf1cef7bceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.099866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68433383-3801-4679-b06e-bf1cef7bceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.112160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4b0be811-8333-41a6-8343-68f678c85cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf22f91633b647249af8661c54fc52e5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:38.139958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1046/2076] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:37 2022] DELETE /identity/v3/users/cf22f91633b647249af8661c54fc52e5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:38.149895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d848-84ee-461d-8451-23c46b7c082f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.156200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d848-84ee-461d-8451-23c46b7c082f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.156664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738d848-84ee-461d-8451-23c46b7c082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.168297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-68433383-3801-4679-b06e-bf1cef7bceb3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:38.171980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-68433383-3801-4679-b06e-bf1cef7bceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:38.193586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-9738d848-84ee-461d-8451-23c46b7c082f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:38.193818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9738d848-84ee-461d-8451-23c46b7c082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:38.336842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1047/2077] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:38.339740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1031/2078] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:38.340858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c733fb-65eb-4398-a0c2-d08a37ba4038 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.341396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c733fb-65eb-4398-a0c2-d08a37ba4038 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.341856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c733fb-65eb-4398-a0c2-d08a37ba4038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.357182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433383-3801-4679-b06e-bf1cef7bceb3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.358951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-68433383-3801-4679-b06e-bf1cef7bceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:38.374222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-90c733fb-65eb-4398-a0c2-d08a37ba4038 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:38.376049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-90c733fb-65eb-4398-a0c2-d08a37ba4038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:38.385284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1048/2079] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:38.395130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c733fb-65eb-4398-a0c2-d08a37ba4038 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.413017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c733fb-65eb-4398-a0c2-d08a37ba4038 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.418609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.419379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.419738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.420091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.421268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:38.421867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.423877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.442155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1049/2080] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:38.442356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:38.443508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.461446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591082c8-8ab1-4037-91a2-36dcd7db5f22 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.467775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.468834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.469122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.469403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.470145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.472572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.478106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68433383-3801-4679-b06e-bf1cef7bceb3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.482802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65514a7-4078-4ad7-b39e-35b19cff73fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.483551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65514a7-4078-4ad7-b39e-35b19cff73fd service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.483944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65514a7-4078-4ad7-b39e-35b19cff73fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.484306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65514a7-4078-4ad7-b39e-35b19cff73fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.496864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65514a7-4078-4ad7-b39e-35b19cff73fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.499275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65514a7-4078-4ad7-b39e-35b19cff73fd service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.515717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1032/2081] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:38.554167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1050/2082] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:38 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:38.559486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65514a7-4078-4ad7-b39e-35b19cff73fd service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.578087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65514a7-4078-4ad7-b39e-35b19cff73fd service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.680640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.682409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:38.691053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:38.691258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7666-15a4-477e-bf70-434d616ae239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.692068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7666-15a4-477e-bf70-434d616ae239 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.692447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7666-15a4-477e-bf70-434d616ae239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.692727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7666-15a4-477e-bf70-434d616ae239 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.693393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e7666-15a4-477e-bf70-434d616ae239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.695464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e7666-15a4-477e-bf70-434d616ae239 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.726769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1033/2083] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:38 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:38.731214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7666-15a4-477e-bf70-434d616ae239 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.745475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7666-15a4-477e-bf70-434d616ae239 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.751894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f2da-825a-469c-90c7-3e378f60314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.752514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f2da-825a-469c-90c7-3e378f60314d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.752799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f2da-825a-469c-90c7-3e378f60314d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.753080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2f2da-825a-469c-90c7-3e378f60314d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.753732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2f2da-825a-469c-90c7-3e378f60314d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.756593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2f2da-825a-469c-90c7-3e378f60314d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.771108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1034/2084] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:38.774775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f2da-825a-469c-90c7-3e378f60314d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.784428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca349-a10d-42ad-8321-475b711609fe admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.785952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2f2da-825a-469c-90c7-3e378f60314d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.788246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.788866 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.789149 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.789429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.791658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:38.792323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f64d19-73a0-4be4-96e8-c5620fbe79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.793568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64d19-73a0-4be4-96e8-c5620fbe79b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.793840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64d19-73a0-4be4-96e8-c5620fbe79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.794207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64d19-73a0-4be4-96e8-c5620fbe79b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.794987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f64d19-73a0-4be4-96e8-c5620fbe79b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.797661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f64d19-73a0-4be4-96e8-c5620fbe79b7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.827219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1035/2085] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:38.832233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f64d19-73a0-4be4-96e8-c5620fbe79b7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.847038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f64d19-73a0-4be4-96e8-c5620fbe79b7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.854155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bac35-4974-4e3e-a42a-46c02b584a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.855048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bac35-4974-4e3e-a42a-46c02b584a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.855396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bac35-4974-4e3e-a42a-46c02b584a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.855746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bac35-4974-4e3e-a42a-46c02b584a76 admin admin] PATH_INFO: `/v3/projects/1de5f2f7a76c441799471910055d9c33/users/5fe36a619ace46f1a1d6a0d984530cda/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.868187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.869668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.884705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1051/2086] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:19:38.885920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:38.887248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bac35-4974-4e3e-a42a-46c02b584a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de5f2f7a76c441799471910055d9c33, user_id=5fe36a619ace46f1a1d6a0d984530cda, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.887742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:38.892719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bac35-4974-4e3e-a42a-46c02b584a76 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:38.906849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2f584-fe88-4e40-b4f7-acfe8f112e5e service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:38.914615 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1036/2087] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:38 2022] PUT /identity/v3/projects/1de5f2f7a76c441799471910055d9c33/users/5fe36a619ace46f1a1d6a0d984530cda/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:38.927814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830472-78a6-4a32-8e5b-b183ec6b020f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.928139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830472-78a6-4a32-8e5b-b183ec6b020f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.928811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830472-78a6-4a32-8e5b-b183ec6b020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.967284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-05830472-78a6-4a32-8e5b-b183ec6b020f None None] MFA Rules not processed for user `5fe36a619ace46f1a1d6a0d984530cda`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:38.968881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-05830472-78a6-4a32-8e5b-b183ec6b020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:38.986564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:38.987250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:38.987522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:38.987801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] PATH_INFO: `/v3/projects/a27e4b257a754e8e8988545f4d4b8f85` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:38.988967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27e4b257a754e8e8988545f4d4b8f85)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:38.990982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:39.069556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27e4b257a754e8e8988545f4d4b8f85', 'request_id': 'req-3c26813f-f9d9-478a-9bb5-742fc8825b4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:39.088591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27e4b257a754e8e8988545f4d4b8f85', 'request_id': 'req-3c26813f-f9d9-478a-9bb5-742fc8825b4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:39.095484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:39.102823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1037/2088] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:39.107461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27e4b257a754e8e8988545f4d4b8f85', 'request_id': 'req-3c26813f-f9d9-478a-9bb5-742fc8825b4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:39.111861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830472-78a6-4a32-8e5b-b183ec6b020f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:39.118225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:39.140790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] The token cache is being invalidate because project a27e4b257a754e8e8988545f4d4b8f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:39.141616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:39.142515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3c26813f-f9d9-478a-9bb5-742fc8825b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:39.144947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1052/2089] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:38 2022] DELETE /identity/v3/projects/a27e4b257a754e8e8988545f4d4b8f85 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:39.152602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37818162-8fd7-43d3-9d81-dbaac8891bd1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.153286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37818162-8fd7-43d3-9d81-dbaac8891bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.154033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37818162-8fd7-43d3-9d81-dbaac8891bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.176577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-37818162-8fd7-43d3-9d81-dbaac8891bd1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:39.178421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-37818162-8fd7-43d3-9d81-dbaac8891bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:39.178588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05830472-78a6-4a32-8e5b-b183ec6b020f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:39.243379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:39.244153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.244432 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.244712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.246945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:39.250129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1053/2090] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:39.256808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6089f-35b5-43e6-8d14-99c4642b37eb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.257010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6089f-35b5-43e6-8d14-99c4642b37eb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.257276 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6089f-35b5-43e6-8d14-99c4642b37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.279479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-dfa6089f-35b5-43e6-8d14-99c4642b37eb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:39.281375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-dfa6089f-35b5-43e6-8d14-99c4642b37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:39.297552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1054/2091] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:39.298684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6089f-35b5-43e6-8d14-99c4642b37eb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:39.310400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6089f-35b5-43e6-8d14-99c4642b37eb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:39.323107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:39.323912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.324423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.324962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.326047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:39.326519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:39.328556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:39.330808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:39.332868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:39.343777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1038/2092] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:39.348906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1055/2093] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:39.350456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:39.364028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb7c60-793d-457a-9c8c-71b25f1295b7 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:39.371354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162ee21-6caf-4bd5-b490-4b8d9f716ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:39.371975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ee21-6caf-4bd5-b490-4b8d9f716ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.372250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ee21-6caf-4bd5-b490-4b8d9f716ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.372530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ee21-6caf-4bd5-b490-4b8d9f716ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.373165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162ee21-6caf-4bd5-b490-4b8d9f716ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:39.375417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162ee21-6caf-4bd5-b490-4b8d9f716ae2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:39.423874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1039/2094] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:39 2022] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:39.425421 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:39.438608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc533-e4f7-4d81-ae6a-d5c80f25261b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:39.511164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb93b6-1736-415c-8035-e5f6fd4214a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:39.511783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb93b6-1736-415c-8035-e5f6fd4214a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.512717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb93b6-1736-415c-8035-e5f6fd4214a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.513009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb93b6-1736-415c-8035-e5f6fd4214a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.513644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb93b6-1736-415c-8035-e5f6fd4214a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:39.516780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb93b6-1736-415c-8035-e5f6fd4214a5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:39.542134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1056/2095] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:39 2022] POST /identity/v3/users => generated 281 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:39.543570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162ee21-6caf-4bd5-b490-4b8d9f716ae2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:39.556787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162ee21-6caf-4bd5-b490-4b8d9f716ae2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:39.564833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e18d-aafa-4d6e-aaf6-1edfb792398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:39.565594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e18d-aafa-4d6e-aaf6-1edfb792398b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.565910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e18d-aafa-4d6e-aaf6-1edfb792398b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.566182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e18d-aafa-4d6e-aaf6-1edfb792398b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.566839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e18d-aafa-4d6e-aaf6-1edfb792398b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:39.568638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e18d-aafa-4d6e-aaf6-1edfb792398b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:39.585915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1040/2096] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:39.590054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb93b6-1736-415c-8035-e5f6fd4214a5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:39.613524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb93b6-1736-415c-8035-e5f6fd4214a5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:39.620852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e7efc-d513-4f5f-8bfc-dc7386641cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:39.621667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7efc-d513-4f5f-8bfc-dc7386641cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.622002 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7efc-d513-4f5f-8bfc-dc7386641cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.622316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e7efc-d513-4f5f-8bfc-dc7386641cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.622977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e7efc-d513-4f5f-8bfc-dc7386641cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:39.625345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e7efc-d513-4f5f-8bfc-dc7386641cd2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:39.646266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1057/2097] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:39.647754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e18d-aafa-4d6e-aaf6-1edfb792398b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:39.660418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e18d-aafa-4d6e-aaf6-1edfb792398b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:39.665764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:39.666563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.666847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.667180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] PATH_INFO: `/v3/projects/074c03d73f8949a4b0600f45755b6564/users/c024d985ac564d2babc5c6703d25b9bd/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.704414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=074c03d73f8949a4b0600f45755b6564, user_id=c024d985ac564d2babc5c6703d25b9bd, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:39.707426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:39.724260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1041/2098] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:39 2022] PUT /identity/v3/projects/074c03d73f8949a4b0600f45755b6564/users/c024d985ac564d2babc5c6703d25b9bd/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:39.738874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d8a3-0e8a-42fd-ab97-587fac9dcbe4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:39.739749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d8a3-0e8a-42fd-ab97-587fac9dcbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:39.740193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419d8a3-0e8a-42fd-ab97-587fac9dcbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:39.784794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c419d8a3-0e8a-42fd-ab97-587fac9dcbe4 None None] MFA Rules not processed for user `c024d985ac564d2babc5c6703d25b9bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:39.786015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c419d8a3-0e8a-42fd-ab97-587fac9dcbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:39.828105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:39.895150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1058/2099] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:39.936463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:39.939895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:39.959533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:40.003474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb570972-d39e-43a1-9ebc-02d60763caeb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:40.007316 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09dde22-3fa5-4aa8-98fc-72ca8299ac4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:40.007995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dde22-3fa5-4aa8-98fc-72ca8299ac4a service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.008276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dde22-3fa5-4aa8-98fc-72ca8299ac4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.008522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dde22-3fa5-4aa8-98fc-72ca8299ac4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.017912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dde22-3fa5-4aa8-98fc-72ca8299ac4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:40.019413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09dde22-3fa5-4aa8-98fc-72ca8299ac4a service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:40.028976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1042/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:40.046407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419d8a3-0e8a-42fd-ab97-587fac9dcbe4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:40.113153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419d8a3-0e8a-42fd-ab97-587fac9dcbe4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:40.117667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:40.118298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.118576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.118849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] PATH_INFO: `/v3/users/c024d985ac564d2babc5c6703d25b9bd` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.120024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c024d985ac564d2babc5c6703d25b9bd)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:40.121922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:40.173072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c024d985ac564d2babc5c6703d25b9bd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.181372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c024d985ac564d2babc5c6703d25b9bd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.182197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c024d985ac564d2babc5c6703d25b9bd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.182981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c024d985ac564d2babc5c6703d25b9bd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.196715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c024d985ac564d2babc5c6703d25b9bd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.211964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1059/2101] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:40 2022] DELETE /identity/v3/users/c024d985ac564d2babc5c6703d25b9bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:40.216601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321973e-3510-41f5-99dd-4ef576594f16 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.216974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321973e-3510-41f5-99dd-4ef576594f16 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.217838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321973e-3510-41f5-99dd-4ef576594f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.239303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9321973e-3510-41f5-99dd-4ef576594f16 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:40.240730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9321973e-3510-41f5-99dd-4ef576594f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:40.334289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1043/2102] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:40.344174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:40.347114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:40.431119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7343a6-5b55-4cb3-8a45-dd0b205f169b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:40.435610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596eb74-033b-4f0c-a8ef-5686da0c99dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:40.437250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596eb74-033b-4f0c-a8ef-5686da0c99dc service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.437594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596eb74-033b-4f0c-a8ef-5686da0c99dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.437795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596eb74-033b-4f0c-a8ef-5686da0c99dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.448781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:40.453952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596eb74-033b-4f0c-a8ef-5686da0c99dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:40.455481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596eb74-033b-4f0c-a8ef-5686da0c99dc service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:40.466701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1060/2103] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:40.806575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321973e-3510-41f5-99dd-4ef576594f16 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:40.808191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9321973e-3510-41f5-99dd-4ef576594f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:40.830226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321973e-3510-41f5-99dd-4ef576594f16 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:40.835789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:40.836522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.836829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.837063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] PATH_INFO: `/v3/projects/074c03d73f8949a4b0600f45755b6564` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.838268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=074c03d73f8949a4b0600f45755b6564)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:40.840186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:40.898177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '074c03d73f8949a4b0600f45755b6564', 'request_id': 'req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.906431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '074c03d73f8949a4b0600f45755b6564', 'request_id': 'req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.914977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '074c03d73f8949a4b0600f45755b6564', 'request_id': 'req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.944835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] The token cache is being invalidate because project 074c03d73f8949a4b0600f45755b6564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:40.945324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.946031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2d5231f1-6eeb-4a77-aa49-6c5d0cb31c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:40.947951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1044/2104] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:40 2022] DELETE /identity/v3/projects/074c03d73f8949a4b0600f45755b6564 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:40.954870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23816f-c32c-44ae-9fe4-e1fbbc12cc4f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:40.954870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23816f-c32c-44ae-9fe4-e1fbbc12cc4f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:40.954870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23816f-c32c-44ae-9fe4-e1fbbc12cc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:40.981359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3d23816f-c32c-44ae-9fe4-e1fbbc12cc4f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:40.983538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3d23816f-c32c-44ae-9fe4-e1fbbc12cc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:41.068955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1061/2105] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:41.077310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9551d0-56b5-46bd-8c3f-f96c7cded739 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.077767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9551d0-56b5-46bd-8c3f-f96c7cded739 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.078170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9551d0-56b5-46bd-8c3f-f96c7cded739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.099262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8a9551d0-56b5-46bd-8c3f-f96c7cded739 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:41.100654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a9551d0-56b5-46bd-8c3f-f96c7cded739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:41.110565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1045/2106] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:41.116029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23816f-c32c-44ae-9fe4-e1fbbc12cc4f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:41.128373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23816f-c32c-44ae-9fe4-e1fbbc12cc4f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:41.135714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:41.136550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.136926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.137361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.138319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:41.138691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:41.141194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:41.153933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1062/2107] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:41.158782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9551d0-56b5-46bd-8c3f-f96c7cded739 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:41.168000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9551d0-56b5-46bd-8c3f-f96c7cded739 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:41.172808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14231890-bcab-4eef-9b2b-234bf2ec2874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:41.173575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231890-bcab-4eef-9b2b-234bf2ec2874 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.173860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231890-bcab-4eef-9b2b-234bf2ec2874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.174136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14231890-bcab-4eef-9b2b-234bf2ec2874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.174905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14231890-bcab-4eef-9b2b-234bf2ec2874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:41.177395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14231890-bcab-4eef-9b2b-234bf2ec2874 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:41.205136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1046/2108] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:41 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:41.209388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:41.220278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4de34a-ad99-42fc-b0e2-83e4e095d768 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:41.278791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e489a8-1e81-4aa7-8664-38112081b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:41.279483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e489a8-1e81-4aa7-8664-38112081b6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.279842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e489a8-1e81-4aa7-8664-38112081b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.280630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e489a8-1e81-4aa7-8664-38112081b6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.281272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e489a8-1e81-4aa7-8664-38112081b6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:41.283268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e489a8-1e81-4aa7-8664-38112081b6f8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:41.306618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1063/2109] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:41 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:41.310166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14231890-bcab-4eef-9b2b-234bf2ec2874 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:41.321232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14231890-bcab-4eef-9b2b-234bf2ec2874 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:41.325768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd065c-0180-439f-8225-fc8d593b6ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:41.326351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd065c-0180-439f-8225-fc8d593b6ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.327220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd065c-0180-439f-8225-fc8d593b6ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.327797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd065c-0180-439f-8225-fc8d593b6ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.328456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd065c-0180-439f-8225-fc8d593b6ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:41.330119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd065c-0180-439f-8225-fc8d593b6ba8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:41.341030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1047/2110] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:41.346427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e489a8-1e81-4aa7-8664-38112081b6f8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:41.358026 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e489a8-1e81-4aa7-8664-38112081b6f8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:41.363658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11320d4-0cf4-4616-842c-42f58ee17dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:41.364414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11320d4-0cf4-4616-842c-42f58ee17dde admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.364763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11320d4-0cf4-4616-842c-42f58ee17dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.365111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11320d4-0cf4-4616-842c-42f58ee17dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.365848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11320d4-0cf4-4616-842c-42f58ee17dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:41.367488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11320d4-0cf4-4616-842c-42f58ee17dde admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:41.379451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1064/2111] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:41.383922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd065c-0180-439f-8225-fc8d593b6ba8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:41.390915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:41.396958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd065c-0180-439f-8225-fc8d593b6ba8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:41.405020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:41.405658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.406132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.407605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] PATH_INFO: `/v3/projects/e5230a908cb047108133e82cb76b3e18/users/ecafbe3f3e4f4e1d84b7443b9877292c/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.424218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5230a908cb047108133e82cb76b3e18, user_id=ecafbe3f3e4f4e1d84b7443b9877292c, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:41.427180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:41.454063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1048/2112] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:41 2022] PUT /identity/v3/projects/e5230a908cb047108133e82cb76b3e18/users/ecafbe3f3e4f4e1d84b7443b9877292c/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:41.460351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817a2f-98fc-4de2-b87f-1afdef882d99 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.460776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817a2f-98fc-4de2-b87f-1afdef882d99 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.461249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817a2f-98fc-4de2-b87f-1afdef882d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.487356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d0817a2f-98fc-4de2-b87f-1afdef882d99 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:41.491502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d0817a2f-98fc-4de2-b87f-1afdef882d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:41.577609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1065/2113] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:41.582588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:41.584338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:41.653034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b4be0-e8e6-4068-88e9-8c33acf560ae admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:41.657216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651112f3-0882-46c2-8bbe-dc2a1a99af51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:41.657875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651112f3-0882-46c2-8bbe-dc2a1a99af51 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:41.658174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651112f3-0882-46c2-8bbe-dc2a1a99af51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:41.658455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651112f3-0882-46c2-8bbe-dc2a1a99af51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:41.667784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651112f3-0882-46c2-8bbe-dc2a1a99af51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:41.669206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651112f3-0882-46c2-8bbe-dc2a1a99af51 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:41.679072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1049/2114] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:42.901734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817a2f-98fc-4de2-b87f-1afdef882d99 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:42.903246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d0817a2f-98fc-4de2-b87f-1afdef882d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:42.910840 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:42.916497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817a2f-98fc-4de2-b87f-1afdef882d99 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:42.923867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:42.925307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:42.925596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:42.926228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] PATH_INFO: `/v3/users/bd4ac6f9d7a24597969024028aacff0b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:42.928065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4ac6f9d7a24597969024028aacff0b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:42.929953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:43.004142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4ac6f9d7a24597969024028aacff0b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:43.013000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4ac6f9d7a24597969024028aacff0b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:43.014115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4ac6f9d7a24597969024028aacff0b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:43.015031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4ac6f9d7a24597969024028aacff0b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:43.046278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4ac6f9d7a24597969024028aacff0b'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:43.062760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1066/2115] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:42 2022] DELETE /identity/v3/users/bd4ac6f9d7a24597969024028aacff0b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:43.067207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee8416-8c21-4e8e-9123-3ae1ce630978 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:43.068067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee8416-8c21-4e8e-9123-3ae1ce630978 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:43.068350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee8416-8c21-4e8e-9123-3ae1ce630978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:43.091276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bcee8416-8c21-4e8e-9123-3ae1ce630978 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:43.093354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bcee8416-8c21-4e8e-9123-3ae1ce630978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:43.184516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1050/2116] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:43.196436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:43.198058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:43.311971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481c7be-e543-4abd-86b4-682b6128f7b8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:43.316016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b3556-4e5b-4e7e-93c2-96506da9c302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:43.316717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b3556-4e5b-4e7e-93c2-96506da9c302 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:43.317074 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b3556-4e5b-4e7e-93c2-96506da9c302 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:43.317633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b3556-4e5b-4e7e-93c2-96506da9c302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:43.331483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b3556-4e5b-4e7e-93c2-96506da9c302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:43.333092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b3556-4e5b-4e7e-93c2-96506da9c302 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:43.351662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1067/2117] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:44.341860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee8416-8c21-4e8e-9123-3ae1ce630978 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:44.344636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bcee8416-8c21-4e8e-9123-3ae1ce630978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:44.367106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee8416-8c21-4e8e-9123-3ae1ce630978 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:44.388785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:44.393041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:44.393327 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:44.393610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] PATH_INFO: `/v3/projects/8388427d8d1e4e63a3782b9dc97b188e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:44.395562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8388427d8d1e4e63a3782b9dc97b188e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:44.398143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:44.479160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8388427d8d1e4e63a3782b9dc97b188e', 'request_id': 'req-63a22a62-b4fb-4666-adf9-c6e204d238cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.488382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8388427d8d1e4e63a3782b9dc97b188e', 'request_id': 'req-63a22a62-b4fb-4666-adf9-c6e204d238cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.498974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8388427d8d1e4e63a3782b9dc97b188e', 'request_id': 'req-63a22a62-b4fb-4666-adf9-c6e204d238cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.518778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] The token cache is being invalidate because project 8388427d8d1e4e63a3782b9dc97b188e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:44.519598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.521320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.524578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1051/2118] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:44 2022] DELETE /identity/v3/projects/8388427d8d1e4e63a3782b9dc97b188e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:44.528228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b3556-4e5b-4e7e-93c2-96506da9c302 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:44.546163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b3556-4e5b-4e7e-93c2-96506da9c302 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:44.658842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:44.660030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:44.660527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:44.661050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] PATH_INFO: `/v3/users/5b3747d06706434e87c99c57fb8f8115` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:44.663878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3747d06706434e87c99c57fb8f8115)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:44.666553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:44.709841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:44.776510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3747d06706434e87c99c57fb8f8115'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.805678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3747d06706434e87c99c57fb8f8115'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.807586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3747d06706434e87c99c57fb8f8115'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.808040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3747d06706434e87c99c57fb8f8115'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.828619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3747d06706434e87c99c57fb8f8115'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:44.860445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1068/2119] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:44 2022] DELETE /identity/v3/users/5b3747d06706434e87c99c57fb8f8115 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:45.547098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:45.549598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:45.573426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:45.580598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a22a62-b4fb-4666-adf9-c6e204d238cb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:45.661633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:45.662289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:45.662568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:45.662843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] PATH_INFO: `/v3/projects/fa177c5adab442b8a02069c90526f1e6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:45.664038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa177c5adab442b8a02069c90526f1e6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:45.665954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:45.733731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa177c5adab442b8a02069c90526f1e6', 'request_id': 'req-e1a7566d-b943-489e-aabc-d34afad7e6cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:45.745625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa177c5adab442b8a02069c90526f1e6', 'request_id': 'req-e1a7566d-b943-489e-aabc-d34afad7e6cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:45.759890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa177c5adab442b8a02069c90526f1e6', 'request_id': 'req-e1a7566d-b943-489e-aabc-d34afad7e6cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:45.791497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] The token cache is being invalidate because project fa177c5adab442b8a02069c90526f1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:45.791830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:45.794284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:45.796966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1052/2120] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:45 2022] DELETE /identity/v3/projects/fa177c5adab442b8a02069c90526f1e6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:45.800848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:45.807035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:45.822064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f279810-f734-4640-be11-83d05ac1dfa7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:45.914289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:45.915138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:45.915426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:45.915715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] PATH_INFO: `/v3/users/09ef67b3cc7949a580e20b2b83c3feda` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:45.917003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ef67b3cc7949a580e20b2b83c3feda)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:45.919779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:46.011608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ef67b3cc7949a580e20b2b83c3feda'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.024619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ef67b3cc7949a580e20b2b83c3feda'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.025263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ef67b3cc7949a580e20b2b83c3feda'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.026361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ef67b3cc7949a580e20b2b83c3feda'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.049500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-533794b9-f192-4447-b5dd-96d61dca5a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ef67b3cc7949a580e20b2b83c3feda'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.067510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1069/2121] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:45 2022] DELETE /identity/v3/users/09ef67b3cc7949a580e20b2b83c3feda => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:46.535549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:46.537685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:46.567329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7566d-b943-489e-aabc-d34afad7e6cb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:46.661957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:46.662608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:46.663131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:46.663628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] PATH_INFO: `/v3/projects/f3b6357a1ff143f2b78f0fd9da52cdfa` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:46.665080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b6357a1ff143f2b78f0fd9da52cdfa)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:46.668284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:46.728519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:46.754098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b6357a1ff143f2b78f0fd9da52cdfa', 'request_id': 'req-1ed9217e-fc44-44e0-8a75-e22096944983'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.761110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b6357a1ff143f2b78f0fd9da52cdfa', 'request_id': 'req-1ed9217e-fc44-44e0-8a75-e22096944983'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.793746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b6357a1ff143f2b78f0fd9da52cdfa', 'request_id': 'req-1ed9217e-fc44-44e0-8a75-e22096944983'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.810566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] The token cache is being invalidate because project f3b6357a1ff143f2b78f0fd9da52cdfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:46.811253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.812504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1ed9217e-fc44-44e0-8a75-e22096944983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:46.815214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1053/2122] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:46 2022] DELETE /identity/v3/projects/f3b6357a1ff143f2b78f0fd9da52cdfa => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:46.820499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59406d4-325e-4d3b-832e-37c8d91197cb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:46.821410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59406d4-325e-4d3b-832e-37c8d91197cb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:46.821805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59406d4-325e-4d3b-832e-37c8d91197cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:46.847982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a59406d4-325e-4d3b-832e-37c8d91197cb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:46.849380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a59406d4-325e-4d3b-832e-37c8d91197cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:46.861311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:46.934893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1070/2123] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:46.936569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb70d9-d50d-4dbd-b766-9b4f3879939d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:46.936863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb70d9-d50d-4dbd-b766-9b4f3879939d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:46.937148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb70d9-d50d-4dbd-b766-9b4f3879939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:46.981884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e3eb70d9-d50d-4dbd-b766-9b4f3879939d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:46.983765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e3eb70d9-d50d-4dbd-b766-9b4f3879939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:46.993089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1054/2124] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:46.999064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59406d4-325e-4d3b-832e-37c8d91197cb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:47.011748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59406d4-325e-4d3b-832e-37c8d91197cb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:47.019039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:47.025022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:47.028513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:47.029234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.032035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:47.034952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:47.038446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:47.067845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1071/2125] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:19:47.072364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb70d9-d50d-4dbd-b766-9b4f3879939d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:47.091616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb70d9-d50d-4dbd-b766-9b4f3879939d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:47.106910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd350446-8843-42e9-aa78-c6825214fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:47.107674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd350446-8843-42e9-aa78-c6825214fae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:47.108055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd350446-8843-42e9-aa78-c6825214fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:47.108650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd350446-8843-42e9-aa78-c6825214fae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.109097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd350446-8843-42e9-aa78-c6825214fae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:47.112448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd350446-8843-42e9-aa78-c6825214fae7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:47.164617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1055/2126] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:47 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:47.169168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:47.180759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be90981-b95e-4d8f-826a-1b908eba00b9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:47.275920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151830e7-8283-432b-93fb-207fb3ad8525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:47.276919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151830e7-8283-432b-93fb-207fb3ad8525 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:47.277280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151830e7-8283-432b-93fb-207fb3ad8525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:47.277791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151830e7-8283-432b-93fb-207fb3ad8525 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.278544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151830e7-8283-432b-93fb-207fb3ad8525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:47.281584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151830e7-8283-432b-93fb-207fb3ad8525 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:47.353199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1072/2127] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:47 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:47.358159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd350446-8843-42e9-aa78-c6825214fae7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:47.379864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd350446-8843-42e9-aa78-c6825214fae7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:47.385284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3db48-b698-4344-ad11-394d8aa0e577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:47.386026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3db48-b698-4344-ad11-394d8aa0e577 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:47.386372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3db48-b698-4344-ad11-394d8aa0e577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:47.386716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3db48-b698-4344-ad11-394d8aa0e577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.387599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3db48-b698-4344-ad11-394d8aa0e577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:47.390168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3db48-b698-4344-ad11-394d8aa0e577 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:47.406114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1056/2128] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:47.410051 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151830e7-8283-432b-93fb-207fb3ad8525 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:47.446826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151830e7-8283-432b-93fb-207fb3ad8525 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:47.453481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f79ed4-1a7d-407a-bfc1-0902372a3f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:47.470805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f79ed4-1a7d-407a-bfc1-0902372a3f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:47.472415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f79ed4-1a7d-407a-bfc1-0902372a3f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:47.472807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f79ed4-1a7d-407a-bfc1-0902372a3f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.473942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f79ed4-1a7d-407a-bfc1-0902372a3f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:47.483032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f79ed4-1a7d-407a-bfc1-0902372a3f13 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:47.518329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1073/2129] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:47.522449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3db48-b698-4344-ad11-394d8aa0e577 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:47.534492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3db48-b698-4344-ad11-394d8aa0e577 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:47.551183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:47.552725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:47.555018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:47.555400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] PATH_INFO: `/v3/projects/0714e5114bea4b7fb32d30561889e619/users/d5a34155a2024575b0869a58cbf0cddb/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.585245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0714e5114bea4b7fb32d30561889e619, user_id=d5a34155a2024575b0869a58cbf0cddb, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:47.591543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:47.637404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1057/2130] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:47 2022] PUT /identity/v3/projects/0714e5114bea4b7fb32d30561889e619/users/d5a34155a2024575b0869a58cbf0cddb/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:47.650782 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767027-f611-43f6-9c95-7c1236ab1cc3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:47.651098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767027-f611-43f6-9c95-7c1236ab1cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:47.652010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb767027-f611-43f6-9c95-7c1236ab1cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:47.703118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bb767027-f611-43f6-9c95-7c1236ab1cc3 None None] MFA Rules not processed for user `d5a34155a2024575b0869a58cbf0cddb`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:47.704557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bb767027-f611-43f6-9c95-7c1236ab1cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:47.820620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1074/2131] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:47.920092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:47.922316 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:48.103082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e370c-3974-48e6-bbfb-4f1174e55bdb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:48.121109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:48.121753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:48.122034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:48.122314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:48.177201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:48.178869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:48.216628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1058/2132] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:47 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:48.603429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01316-720c-4068-b9ef-c1b46470e57d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:48.603729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01316-720c-4068-b9ef-c1b46470e57d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:48.604009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef01316-720c-4068-b9ef-c1b46470e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:48.626100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:48.643136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bef01316-720c-4068-b9ef-c1b46470e57d None None] MFA Rules not processed for user `ecafbe3f3e4f4e1d84b7443b9877292c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:48.644603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bef01316-720c-4068-b9ef-c1b46470e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:48.718268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1075/2133] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:48.723510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:48.725340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:48.800350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56c002-9c27-496d-8729-f7ecdba4782b service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:48.805059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efed05-aae5-4824-94df-a703897f00e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:48.805740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efed05-aae5-4824-94df-a703897f00e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:48.806022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efed05-aae5-4824-94df-a703897f00e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:48.806295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efed05-aae5-4824-94df-a703897f00e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:48.806939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efed05-aae5-4824-94df-a703897f00e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:48.808956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efed05-aae5-4824-94df-a703897f00e4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:48.820352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:48.843317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1059/2134] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:48 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:48.844972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01316-720c-4068-b9ef-c1b46470e57d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:48.857950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef01316-720c-4068-b9ef-c1b46470e57d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:48.928967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f69b6-6015-4328-9ed5-9b44b18e2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:48.929739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f69b6-6015-4328-9ed5-9b44b18e2497 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:48.930112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f69b6-6015-4328-9ed5-9b44b18e2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:48.930458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f69b6-6015-4328-9ed5-9b44b18e2497 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:48.931792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f69b6-6015-4328-9ed5-9b44b18e2497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:48.933988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f69b6-6015-4328-9ed5-9b44b18e2497 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:48.974386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1076/2135] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:48 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:48.974678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efed05-aae5-4824-94df-a703897f00e4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:48.990513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efed05-aae5-4824-94df-a703897f00e4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:49.002188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36cce3-9266-49e3-965f-973f8110e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:49.003058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36cce3-9266-49e3-965f-973f8110e6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:49.003319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36cce3-9266-49e3-965f-973f8110e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:49.003598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36cce3-9266-49e3-965f-973f8110e6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:49.004259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36cce3-9266-49e3-965f-973f8110e6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:49.005869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36cce3-9266-49e3-965f-973f8110e6e1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:49.020623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1060/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:19:49.024826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f69b6-6015-4328-9ed5-9b44b18e2497 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:49.037748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f69b6-6015-4328-9ed5-9b44b18e2497 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:49.051728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c4fe0-2703-4926-bf17-3a4313233267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:49.052336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c4fe0-2703-4926-bf17-3a4313233267 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:49.052623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c4fe0-2703-4926-bf17-3a4313233267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:49.052902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c4fe0-2703-4926-bf17-3a4313233267 admin admin] PATH_INFO: `/v3/projects/585ad0db5c554d20b209e1b9d23b8250/users/a8871481b29840fbb67fbf7c4e0b9dae/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:49.072382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c4fe0-2703-4926-bf17-3a4313233267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585ad0db5c554d20b209e1b9d23b8250, user_id=a8871481b29840fbb67fbf7c4e0b9dae, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:49.075286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c4fe0-2703-4926-bf17-3a4313233267 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:49.098445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1077/2137] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:49 2022] PUT /identity/v3/projects/585ad0db5c554d20b209e1b9d23b8250/users/a8871481b29840fbb67fbf7c4e0b9dae/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:49.103382 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36cce3-9266-49e3-965f-973f8110e6e1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:49.116027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36cce3-9266-49e3-965f-973f8110e6e1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:49.197380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8924f0-158f-47b8-a4ab-07098376dc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:49.198275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8924f0-158f-47b8-a4ab-07098376dc0b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:49.198753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8924f0-158f-47b8-a4ab-07098376dc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:49.199237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8924f0-158f-47b8-a4ab-07098376dc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:49.200604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8924f0-158f-47b8-a4ab-07098376dc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:49.202468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8924f0-158f-47b8-a4ab-07098376dc0b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:49.221993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1061/2138] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:49.226725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c4fe0-2703-4926-bf17-3a4313233267 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:49.249454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c4fe0-2703-4926-bf17-3a4313233267 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:49.257644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932007c-e242-4048-b2ac-16ecff062327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:49.258329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932007c-e242-4048-b2ac-16ecff062327 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:49.258666 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932007c-e242-4048-b2ac-16ecff062327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:49.258868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932007c-e242-4048-b2ac-16ecff062327 admin admin] PATH_INFO: `/v3/projects/585ad0db5c554d20b209e1b9d23b8250/users/a8871481b29840fbb67fbf7c4e0b9dae/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:49.264818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932007c-e242-4048-b2ac-16ecff062327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585ad0db5c554d20b209e1b9d23b8250, user_id=a8871481b29840fbb67fbf7c4e0b9dae, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:49.267811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932007c-e242-4048-b2ac-16ecff062327 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:49.282875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1078/2139] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:49 2022] PUT /identity/v3/projects/585ad0db5c554d20b209e1b9d23b8250/users/a8871481b29840fbb67fbf7c4e0b9dae/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:50.755019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8924f0-158f-47b8-a4ab-07098376dc0b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:50.823306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8924f0-158f-47b8-a4ab-07098376dc0b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:50.880424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248e2b9-36c9-4db3-8093-4bec33745976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:50.881726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248e2b9-36c9-4db3-8093-4bec33745976 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:50.881726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248e2b9-36c9-4db3-8093-4bec33745976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:50.881726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248e2b9-36c9-4db3-8093-4bec33745976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:50.884604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3248e2b9-36c9-4db3-8093-4bec33745976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:50.965203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:51.004639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248e2b9-36c9-4db3-8093-4bec33745976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:51.006715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248e2b9-36c9-4db3-8093-4bec33745976 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:51.024438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1062/2140] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:53.570543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932007c-e242-4048-b2ac-16ecff062327 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:53.712910 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:53.742451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932007c-e242-4048-b2ac-16ecff062327 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:53.757262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:53.758151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:53.758533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:53.758872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] PATH_INFO: `/v3/users/d5a34155a2024575b0869a58cbf0cddb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:53.761518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a34155a2024575b0869a58cbf0cddb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:53.769066 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:53.865201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a34155a2024575b0869a58cbf0cddb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:53.877468 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a34155a2024575b0869a58cbf0cddb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:53.878386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a34155a2024575b0869a58cbf0cddb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:53.879234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a34155a2024575b0869a58cbf0cddb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:53.905237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a34155a2024575b0869a58cbf0cddb'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:53.920512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1079/2141] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:53 2022] DELETE /identity/v3/users/d5a34155a2024575b0869a58cbf0cddb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:53.926715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297c7d1-085d-4d43-8965-1068d49743a4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:53.928693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297c7d1-085d-4d43-8965-1068d49743a4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:53.929162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297c7d1-085d-4d43-8965-1068d49743a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:53.960718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2297c7d1-085d-4d43-8965-1068d49743a4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:53.962228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2297c7d1-085d-4d43-8965-1068d49743a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:54.067390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1063/2142] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:54.111804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:54.114503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:54.339725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fa969-e758-4ffb-ad96-08f3dc3a8ad8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:54.355406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d979c21-8048-4bf2-ad50-817a9aff0af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:54.356045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d979c21-8048-4bf2-ad50-817a9aff0af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:54.357119 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d979c21-8048-4bf2-ad50-817a9aff0af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:54.359787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d979c21-8048-4bf2-ad50-817a9aff0af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:54.387375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d979c21-8048-4bf2-ad50-817a9aff0af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:54.389745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d979c21-8048-4bf2-ad50-817a9aff0af3 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:54.406567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1080/2143] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:55.347974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297c7d1-085d-4d43-8965-1068d49743a4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:55.350021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2297c7d1-085d-4d43-8965-1068d49743a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:55.387035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297c7d1-085d-4d43-8965-1068d49743a4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:55.408035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:55.409979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:55.410439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:55.410883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] PATH_INFO: `/v3/projects/0714e5114bea4b7fb32d30561889e619` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:55.413255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0714e5114bea4b7fb32d30561889e619)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:55.415434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:55.554883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0714e5114bea4b7fb32d30561889e619', 'request_id': 'req-b674337d-7611-4644-94fc-c80b1ecce96a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:55.575623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0714e5114bea4b7fb32d30561889e619', 'request_id': 'req-b674337d-7611-4644-94fc-c80b1ecce96a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:55.597243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0714e5114bea4b7fb32d30561889e619', 'request_id': 'req-b674337d-7611-4644-94fc-c80b1ecce96a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:55.637179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] The token cache is being invalidate because project 0714e5114bea4b7fb32d30561889e619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:55.637610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:55.638542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:55.643873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1064/2144] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:55 2022] DELETE /identity/v3/projects/0714e5114bea4b7fb32d30561889e619 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:55.649237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3a5d-277d-4c88-9af8-b70463679542 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:55.649841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3a5d-277d-4c88-9af8-b70463679542 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:55.650039 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c3a5d-277d-4c88-9af8-b70463679542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:55.688831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-643c3a5d-277d-4c88-9af8-b70463679542 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:55.690082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-643c3a5d-277d-4c88-9af8-b70463679542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:55.746678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:55.748713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:55.800721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1081/2145] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:55.808100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d5bc0-3881-4926-9b63-abffb653c550 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:55.808609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d5bc0-3881-4926-9b63-abffb653c550 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:55.809126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d5bc0-3881-4926-9b63-abffb653c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:55.860207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4c9d5bc0-3881-4926-9b63-abffb653c550 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:55.860523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674337d-7611-4644-94fc-c80b1ecce96a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:55.861500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4c9d5bc0-3881-4926-9b63-abffb653c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:55.868106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:55.869903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:55.870296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:55.870643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] PATH_INFO: `/v3/users/5fe36a619ace46f1a1d6a0d984530cda` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:55.872365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe36a619ace46f1a1d6a0d984530cda)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:55.877535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:55.887292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:55.893244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1082/2146] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:55.894928 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d5bc0-3881-4926-9b63-abffb653c550 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:55.926933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d5bc0-3881-4926-9b63-abffb653c550 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:55.952592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:55.954736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:55.954736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:55.955061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:55.961488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:55.961816 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:55.966574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:55.977425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:55.999314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1083/2147] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:56.003478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:56.022261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe36a619ace46f1a1d6a0d984530cda'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:56.027021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a00b3f-b53c-4a50-ae34-0e75ac8cf671 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:56.040648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe36a619ace46f1a1d6a0d984530cda'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:56.042794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe36a619ace46f1a1d6a0d984530cda'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:56.047743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe36a619ace46f1a1d6a0d984530cda'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:56.054689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:56.055953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.056472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.057615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.061154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:56.070813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:56.072728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c0dae82-970f-441c-910f-19bfc8f5a4b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe36a619ace46f1a1d6a0d984530cda'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:56.129033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1065/2148] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:55 2022] DELETE /identity/v3/users/5fe36a619ace46f1a1d6a0d984530cda => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:19:56.135087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2b48-e948-4ca0-8d1d-ca2f74514021 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.136160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2b48-e948-4ca0-8d1d-ca2f74514021 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.136466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2b48-e948-4ca0-8d1d-ca2f74514021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.163721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1084/2149] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:56 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:56.167438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:56.170432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:56.206539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-37ee2b48-e948-4ca0-8d1d-ca2f74514021 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:56.208229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-37ee2b48-e948-4ca0-8d1d-ca2f74514021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:56.322625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de983c5c-2450-49dd-8a7c-83fcc8f0c04e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:56.329213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26af53-2f8b-4b87-b2b9-bd7aeafd0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:56.329846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26af53-2f8b-4b87-b2b9-bd7aeafd0ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.330191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26af53-2f8b-4b87-b2b9-bd7aeafd0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.330478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26af53-2f8b-4b87-b2b9-bd7aeafd0ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.331179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26af53-2f8b-4b87-b2b9-bd7aeafd0ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:56.334859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26af53-2f8b-4b87-b2b9-bd7aeafd0ea1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:56.377512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1085/2150] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:56 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:19:56.381330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26af53-2f8b-4b87-b2b9-bd7aeafd0ea1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:56.390852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1066/2151] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:56.398109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26af53-2f8b-4b87-b2b9-bd7aeafd0ea1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:56.403576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16850b-345b-4b0e-ac18-088b3b5d195a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:56.405269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16850b-345b-4b0e-ac18-088b3b5d195a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.405625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16850b-345b-4b0e-ac18-088b3b5d195a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.405903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16850b-345b-4b0e-ac18-088b3b5d195a admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.406649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16850b-345b-4b0e-ac18-088b3b5d195a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:56.408534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16850b-345b-4b0e-ac18-088b3b5d195a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:56.423994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2b48-e948-4ca0-8d1d-ca2f74514021 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:56.426694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-37ee2b48-e948-4ca0-8d1d-ca2f74514021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:56.451543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1086/2152] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:56.452826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16850b-345b-4b0e-ac18-088b3b5d195a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:56.480636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16850b-345b-4b0e-ac18-088b3b5d195a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:56.494533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614914d7-946d-4815-a2bf-c7bd80c16b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:56.496270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614914d7-946d-4815-a2bf-c7bd80c16b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.496554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614914d7-946d-4815-a2bf-c7bd80c16b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.496830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614914d7-946d-4815-a2bf-c7bd80c16b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.497586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614914d7-946d-4815-a2bf-c7bd80c16b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:56.500023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614914d7-946d-4815-a2bf-c7bd80c16b83 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:56.562502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1087/2153] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:56.574245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614914d7-946d-4815-a2bf-c7bd80c16b83 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:56.618948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614914d7-946d-4815-a2bf-c7bd80c16b83 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:56.631541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91dfd0-93dc-4312-bfb4-ae5aca62a7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:56.633413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dfd0-93dc-4312-bfb4-ae5aca62a7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.634024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dfd0-93dc-4312-bfb4-ae5aca62a7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.634305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91dfd0-93dc-4312-bfb4-ae5aca62a7ba admin admin] PATH_INFO: `/v3/projects/176cb70c0db546499a450fe57fdcb984/users/f09f6b51114648fbbdc3126e597a0a66/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.637681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2b48-e948-4ca0-8d1d-ca2f74514021 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:56.652363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:56.652999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.653278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.653549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.676850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91dfd0-93dc-4312-bfb4-ae5aca62a7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=176cb70c0db546499a450fe57fdcb984, user_id=f09f6b51114648fbbdc3126e597a0a66, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:56.683296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:56.684988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91dfd0-93dc-4312-bfb4-ae5aca62a7ba admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:56.687667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:56.733942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1088/2154] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:56 2022] PUT /identity/v3/projects/176cb70c0db546499a450fe57fdcb984/users/f09f6b51114648fbbdc3126e597a0a66/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:56.739982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd488b-384b-45af-aa4f-f1220b624d7b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:56.741148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd488b-384b-45af-aa4f-f1220b624d7b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:56.741504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1067/2155] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:56.741626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd488b-384b-45af-aa4f-f1220b624d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:56.807940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-abfd488b-384b-45af-aa4f-f1220b624d7b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:56.813452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-abfd488b-384b-45af-aa4f-f1220b624d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.007450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1089/2156] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:57.034107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:57.035976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.041113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd488b-384b-45af-aa4f-f1220b624d7b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:57.043548 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-abfd488b-384b-45af-aa4f-f1220b624d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.088127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:57.094502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc2546-73b0-4e2a-a739-df0f8a8a4f8c service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:57.106969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:57.108381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.109673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.110348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] PATH_INFO: `/v3/users/9a80fb7510eb4034bcbf610adb63e1a2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.112168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a80fb7510eb4034bcbf610adb63e1a2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:57.116239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:57.173609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:57.187487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd488b-384b-45af-aa4f-f1220b624d7b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:57.191998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:57.192878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.193015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.193363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.222566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a80fb7510eb4034bcbf610adb63e1a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.225984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:57.230396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:57.238911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a80fb7510eb4034bcbf610adb63e1a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.239698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a80fb7510eb4034bcbf610adb63e1a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.241027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a80fb7510eb4034bcbf610adb63e1a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.256257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1090/2157] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:57.259416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a80fb7510eb4034bcbf610adb63e1a2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.284094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1068/2158] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:19:57 2022] DELETE /identity/v3/users/9a80fb7510eb4034bcbf610adb63e1a2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:57.321993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:57.323691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.343599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c0465-838e-426e-8ab3-c6f23f85d6e1 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:57.525586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:57.526456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.526913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.527392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] PATH_INFO: `/v3/projects/1de5f2f7a76c441799471910055d9c33` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.531871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de5f2f7a76c441799471910055d9c33)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:57.534277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:57.612600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:57.614297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.648994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ad19e-104f-4301-b0ce-e59abb718960 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:57.665687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de5f2f7a76c441799471910055d9c33', 'request_id': 'req-6a7b7506-3d80-4409-9b6a-fa7ecca81581'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.679813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de5f2f7a76c441799471910055d9c33', 'request_id': 'req-6a7b7506-3d80-4409-9b6a-fa7ecca81581'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.692050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de5f2f7a76c441799471910055d9c33', 'request_id': 'req-6a7b7506-3d80-4409-9b6a-fa7ecca81581'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.722367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] The token cache is being invalidate because project 1de5f2f7a76c441799471910055d9c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:57.722758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.724773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6a7b7506-3d80-4409-9b6a-fa7ecca81581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.731260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1091/2159] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:57 2022] DELETE /identity/v3/projects/1de5f2f7a76c441799471910055d9c33 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:57.734071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3891-b6d2-48ef-9469-629a25916dac None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.734258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3891-b6d2-48ef-9469-629a25916dac None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.734536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e3891-b6d2-48ef-9469-629a25916dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.744410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:57.745473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.746124 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.746913 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] PATH_INFO: `/v3/projects/90c27bc2b190423da4bf9406b50462c6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.749015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c27bc2b190423da4bf9406b50462c6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:57.751388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:57.772117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-359e3891-b6d2-48ef-9469-629a25916dac None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:57.773358 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-359e3891-b6d2-48ef-9469-629a25916dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.787759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1092/2160] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:57.793557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedca0e-265d-4b0e-90a3-f6c1e51301c2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.795405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedca0e-265d-4b0e-90a3-f6c1e51301c2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.796971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedca0e-265d-4b0e-90a3-f6c1e51301c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.822159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fcedca0e-265d-4b0e-90a3-f6c1e51301c2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:57.823785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fcedca0e-265d-4b0e-90a3-f6c1e51301c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.825235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c27bc2b190423da4bf9406b50462c6', 'request_id': 'req-f5b43a70-7942-484b-b722-f0323f64ace3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.834624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c27bc2b190423da4bf9406b50462c6', 'request_id': 'req-f5b43a70-7942-484b-b722-f0323f64ace3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.847604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c27bc2b190423da4bf9406b50462c6', 'request_id': 'req-f5b43a70-7942-484b-b722-f0323f64ace3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.865888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] The token cache is being invalidate because project 90c27bc2b190423da4bf9406b50462c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:19:57.867351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.868140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f5b43a70-7942-484b-b722-f0323f64ace3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:19:57.870523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1069/2161] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:19:57 2022] DELETE /identity/v3/projects/90c27bc2b190423da4bf9406b50462c6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:57.878440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749903d2-55ec-4e39-9608-b4d5814c1bf7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.878941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749903d2-55ec-4e39-9608-b4d5814c1bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.879287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749903d2-55ec-4e39-9608-b4d5814c1bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.882458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:57.919143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1093/2162] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:57.926787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-749903d2-55ec-4e39-9608-b4d5814c1bf7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:57.927086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-749903d2-55ec-4e39-9608-b4d5814c1bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:57.935033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedca0e-265d-4b0e-90a3-f6c1e51301c2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:57.942105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedca0e-265d-4b0e-90a3-f6c1e51301c2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:57.949380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0d090-6103-4bad-85c5-f4197564a9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:57.950152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0d090-6103-4bad-85c5-f4197564a9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.950427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0d090-6103-4bad-85c5-f4197564a9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.950732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0d090-6103-4bad-85c5-f4197564a9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:57.957715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1070/2163] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:57.961951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0d090-6103-4bad-85c5-f4197564a9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:57.962472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0d090-6103-4bad-85c5-f4197564a9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:57.965201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df224c-6bbc-4793-b6ca-ecc07f967702 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:57.966466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0d090-6103-4bad-85c5-f4197564a9d3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:57.967549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df224c-6bbc-4793-b6ca-ecc07f967702 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:57.967549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df224c-6bbc-4793-b6ca-ecc07f967702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.012924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1094/2164] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:58.015016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40abd-b74c-47cd-8ee5-9632227a0c85 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.015531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40abd-b74c-47cd-8ee5-9632227a0c85 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.015740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd40abd-b74c-47cd-8ee5-9632227a0c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.025869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a8df224c-6bbc-4793-b6ca-ecc07f967702 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:58.027103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a8df224c-6bbc-4793-b6ca-ecc07f967702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:58.047104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1071/2165] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:58.048435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df224c-6bbc-4793-b6ca-ecc07f967702 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.063516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df224c-6bbc-4793-b6ca-ecc07f967702 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.063728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-acd40abd-b74c-47cd-8ee5-9632227a0c85 None None] MFA Rules not processed for user `a8871481b29840fbb67fbf7c4e0b9dae`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:58.064895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-acd40abd-b74c-47cd-8ee5-9632227a0c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:58.069138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109aefd-03f5-4f20-978e-3d1d580cd47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.070019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109aefd-03f5-4f20-978e-3d1d580cd47f admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.070399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109aefd-03f5-4f20-978e-3d1d580cd47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.070781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109aefd-03f5-4f20-978e-3d1d580cd47f admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.072037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109aefd-03f5-4f20-978e-3d1d580cd47f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.073998 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109aefd-03f5-4f20-978e-3d1d580cd47f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.093925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:58.124868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1072/2166] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:58 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:58.127800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109aefd-03f5-4f20-978e-3d1d580cd47f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.179476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1095/2167] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:58.186798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd40abd-b74c-47cd-8ee5-9632227a0c85 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.202008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd40abd-b74c-47cd-8ee5-9632227a0c85 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.286849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109aefd-03f5-4f20-978e-3d1d580cd47f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.303910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.305059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.305233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.305584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2330c-bae0-427a-835f-8f6b316dc376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.306473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2330c-bae0-427a-835f-8f6b316dc376 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.307153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2330c-bae0-427a-835f-8f6b316dc376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.308424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad2330c-bae0-427a-835f-8f6b316dc376 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.309425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2330c-bae0-427a-835f-8f6b316dc376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.319014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.320683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:19:58.322893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.324140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad2330c-bae0-427a-835f-8f6b316dc376 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.325054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.343440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1073/2168] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:19:58.347395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.356218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:58.388474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1096/2169] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:58 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:58.389709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2330c-bae0-427a-835f-8f6b316dc376 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.420735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad2330c-bae0-427a-835f-8f6b316dc376 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.432579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff17395-d8c5-4782-818f-5b7f03b7da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.433444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff17395-d8c5-4782-818f-5b7f03b7da16 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.433861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff17395-d8c5-4782-818f-5b7f03b7da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.434807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff17395-d8c5-4782-818f-5b7f03b7da16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.436411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff17395-d8c5-4782-818f-5b7f03b7da16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.438533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff17395-d8c5-4782-818f-5b7f03b7da16 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.503489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1097/2170] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:58 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:58.503691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e608d53-1d74-4bf8-a6dd-20266d0bdc50 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.503785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff17395-d8c5-4782-818f-5b7f03b7da16 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.547612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:58.604351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff17395-d8c5-4782-818f-5b7f03b7da16 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.610894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164b5c-883b-47ba-b903-10457c3f2f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.611463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164b5c-883b-47ba-b903-10457c3f2f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.611757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164b5c-883b-47ba-b903-10457c3f2f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.611864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a909fc6177e94d2fa6d38dad285e616a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.612034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0164b5c-883b-47ba-b903-10457c3f2f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.612950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.612950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.613481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0164b5c-883b-47ba-b903-10457c3f2f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.613559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.614584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0164b5c-883b-47ba-b903-10457c3f2f96 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.617268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:58.626883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1098/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:58.627766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164b5c-883b-47ba-b903-10457c3f2f96 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.638764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0164b5c-883b-47ba-b903-10457c3f2f96 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.643784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603ee5-8a28-42ca-b810-123ce3f9c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.644400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603ee5-8a28-42ca-b810-123ce3f9c493 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.644681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603ee5-8a28-42ca-b810-123ce3f9c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.644959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f603ee5-8a28-42ca-b810-123ce3f9c493 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.645598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f603ee5-8a28-42ca-b810-123ce3f9c493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.647551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f603ee5-8a28-42ca-b810-123ce3f9c493 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.679059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1099/2172] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:58 2022] POST /identity/v3/users => generated 302 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:58.679756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603ee5-8a28-42ca-b810-123ce3f9c493 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.690155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f603ee5-8a28-42ca-b810-123ce3f9c493 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.695084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.695285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f225-3174-4733-a3ec-71a62f66c1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.696040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f225-3174-4733-a3ec-71a62f66c1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.696376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f225-3174-4733-a3ec-71a62f66c1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.696807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867f225-3174-4733-a3ec-71a62f66c1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.697547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.697655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f225-3174-4733-a3ec-71a62f66c1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.699288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867f225-3174-4733-a3ec-71a62f66c1ff admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.702326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:58.712536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1100/2173] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:58.713601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f225-3174-4733-a3ec-71a62f66c1ff admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.724825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1074/2174] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:58.726369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.727100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867f225-3174-4733-a3ec-71a62f66c1ff admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.732550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c62e6-d92d-4570-9248-9a25959e667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.733243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c62e6-d92d-4570-9248-9a25959e667b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.733557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c62e6-d92d-4570-9248-9a25959e667b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.733981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c62e6-d92d-4570-9248-9a25959e667b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.734723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c62e6-d92d-4570-9248-9a25959e667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.739182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c62e6-d92d-4570-9248-9a25959e667b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.741191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69014197-825e-4201-9155-ba032696c1a8 service glance] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.747242 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ef2ad-af9d-43f7-a48d-380eed5940a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.748270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef2ad-af9d-43f7-a48d-380eed5940a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.749399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef2ad-af9d-43f7-a48d-380eed5940a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.749680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ef2ad-af9d-43f7-a48d-380eed5940a1 admin admin] PATH_INFO: `/v3/projects/fa07e1e2db7242779d5cb78246078820/users/e520f1d390c94369b065721b32ba3131/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.760763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1101/2175] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:58.761813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c62e6-d92d-4570-9248-9a25959e667b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.770771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ef2ad-af9d-43f7-a48d-380eed5940a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa07e1e2db7242779d5cb78246078820, user_id=e520f1d390c94369b065721b32ba3131, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.773555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ef2ad-af9d-43f7-a48d-380eed5940a1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.778398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c62e6-d92d-4570-9248-9a25959e667b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.785456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52d99f-ceea-430b-9701-334fc5686cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.786715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52d99f-ceea-430b-9701-334fc5686cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.786936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52d99f-ceea-430b-9701-334fc5686cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.787283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52d99f-ceea-430b-9701-334fc5686cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.788436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52d99f-ceea-430b-9701-334fc5686cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:58.790223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52d99f-ceea-430b-9701-334fc5686cf6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:58.808766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1102/2176] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:19:58.808958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1075/2177] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:58 2022] PUT /identity/v3/projects/fa07e1e2db7242779d5cb78246078820/users/e520f1d390c94369b065721b32ba3131/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:58.810673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52d99f-ceea-430b-9701-334fc5686cf6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:58.819390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af61eb-4862-4482-b754-8d23838cda9a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.819657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af61eb-4862-4482-b754-8d23838cda9a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.819934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af61eb-4862-4482-b754-8d23838cda9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:58.833994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52d99f-ceea-430b-9701-334fc5686cf6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:58.899155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-56af61eb-4862-4482-b754-8d23838cda9a None None] MFA Rules not processed for user `e520f1d390c94369b065721b32ba3131`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:58.901070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-56af61eb-4862-4482-b754-8d23838cda9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:58.957125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cf277-2d81-4f64-aba6-7289bd705378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:58.957915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cf277-2d81-4f64-aba6-7289bd705378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:58.958292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cf277-2d81-4f64-aba6-7289bd705378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:58.958589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cf277-2d81-4f64-aba6-7289bd705378 admin admin] PATH_INFO: `/v3/projects/59a127f865374643b461bff5fcde6aab/users/945100d825b64251a16b1c5c29e23f71/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.008082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cf277-2d81-4f64-aba6-7289bd705378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a127f865374643b461bff5fcde6aab, user_id=945100d825b64251a16b1c5c29e23f71, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:59.014291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246cf277-2d81-4f64-aba6-7289bd705378 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:59.038475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1076/2178] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:19:59.039789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b5f3-3d44-4a71-801e-0717e34eca73 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.040071 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b5f3-3d44-4a71-801e-0717e34eca73 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.040351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b5f3-3d44-4a71-801e-0717e34eca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.041839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1103/2179] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:19:58 2022] PUT /identity/v3/projects/59a127f865374643b461bff5fcde6aab/users/945100d825b64251a16b1c5c29e23f71/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:19:59.052160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449fbe8-2a7e-4bf7-b9e8-fadff587add5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.052496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449fbe8-2a7e-4bf7-b9e8-fadff587add5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.052822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449fbe8-2a7e-4bf7-b9e8-fadff587add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.096249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b358b5f3-3d44-4a71-801e-0717e34eca73 None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:59.099747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b358b5f3-3d44-4a71-801e-0717e34eca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:59.126406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c449fbe8-2a7e-4bf7-b9e8-fadff587add5 None None] MFA Rules not processed for user `945100d825b64251a16b1c5c29e23f71`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:19:59.128896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c449fbe8-2a7e-4bf7-b9e8-fadff587add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:59.206951 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1077/2180] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:59.208369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b5f3-3d44-4a71-801e-0717e34eca73 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:59.209822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b358b5f3-3d44-4a71-801e-0717e34eca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:59.250769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:59.313467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1104/2181] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:19:59.314758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449fbe8-2a7e-4bf7-b9e8-fadff587add5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:59.316638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c449fbe8-2a7e-4bf7-b9e8-fadff587add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:19:59.323459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b5f3-3d44-4a71-801e-0717e34eca73 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:59.328092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998086-26f8-4069-b723-8259dc469df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:59.328955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998086-26f8-4069-b723-8259dc469df7 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.329498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998086-26f8-4069-b723-8259dc469df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.329828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba998086-26f8-4069-b723-8259dc469df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.369200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:19:59.432831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449fbe8-2a7e-4bf7-b9e8-fadff587add5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:59.438497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2038-4119-45e6-b9dd-e556c9df4220 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:59.439279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2038-4119-45e6-b9dd-e556c9df4220 service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.439672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2038-4119-45e6-b9dd-e556c9df4220 service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.439971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2038-4119-45e6-b9dd-e556c9df4220 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.451543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba998086-26f8-4069-b723-8259dc469df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:59.452792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b2038-4119-45e6-b9dd-e556c9df4220 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:59.454401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b2038-4119-45e6-b9dd-e556c9df4220 service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:59.456460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba998086-26f8-4069-b723-8259dc469df7 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:59.470253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1078/2182] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:19:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:19:59.471652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998086-26f8-4069-b723-8259dc469df7 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:59.476256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1105/2183] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:19:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:19:59.618518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba998086-26f8-4069-b723-8259dc469df7 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:59.634284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f18df-42bc-471d-8143-46c87731eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:59.635049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f18df-42bc-471d-8143-46c87731eed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.635334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f18df-42bc-471d-8143-46c87731eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.635902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f18df-42bc-471d-8143-46c87731eed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.636709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f18df-42bc-471d-8143-46c87731eed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:59.640182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f18df-42bc-471d-8143-46c87731eed8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:19:59.709639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1079/2184] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:19:59 2022] POST /identity/v3/projects => generated 405 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:19:59.711929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2038-4119-45e6-b9dd-e556c9df4220 service swift] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:19:59.733684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2038-4119-45e6-b9dd-e556c9df4220 service swift] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:19:59.975616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ad265-f0f7-4b9b-ad2b-252f20d66fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:19:59.976578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad265-f0f7-4b9b-ad2b-252f20d66fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:19:59.977199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad265-f0f7-4b9b-ad2b-252f20d66fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:19:59.977738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ad265-f0f7-4b9b-ad2b-252f20d66fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:19:59.978745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ad265-f0f7-4b9b-ad2b-252f20d66fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:19:59.985812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ad265-f0f7-4b9b-ad2b-252f20d66fb5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:00.046392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1106/2185] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:19:59 2022] POST /identity/v3/users => generated 309 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:00.051590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f18df-42bc-471d-8143-46c87731eed8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:00.068585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f18df-42bc-471d-8143-46c87731eed8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:00.091849 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406455da-03ec-4099-abfd-496c15db9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:00.095292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406455da-03ec-4099-abfd-496c15db9f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.095574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406455da-03ec-4099-abfd-496c15db9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.098826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406455da-03ec-4099-abfd-496c15db9f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.099551 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406455da-03ec-4099-abfd-496c15db9f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:00.109795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406455da-03ec-4099-abfd-496c15db9f05 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:00.165731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ad265-f0f7-4b9b-ad2b-252f20d66fb5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:00.167674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1080/2186] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:00.194698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ad265-f0f7-4b9b-ad2b-252f20d66fb5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:00.209496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b608db-64ea-4a0f-be8d-dad968d26b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:00.210310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b608db-64ea-4a0f-be8d-dad968d26b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.211990 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b608db-64ea-4a0f-be8d-dad968d26b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.213711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b608db-64ea-4a0f-be8d-dad968d26b47 admin admin] PATH_INFO: `/v3/projects/3439ac21fe1345ac8302cbc0fbd7652f/users/e70af8345d4247f6aa702b5029da6f59/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.251629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b608db-64ea-4a0f-be8d-dad968d26b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3439ac21fe1345ac8302cbc0fbd7652f, user_id=e70af8345d4247f6aa702b5029da6f59, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:00.255270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b608db-64ea-4a0f-be8d-dad968d26b47 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:00.302552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1107/2187] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:00 2022] PUT /identity/v3/projects/3439ac21fe1345ac8302cbc0fbd7652f/users/e70af8345d4247f6aa702b5029da6f59/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:00.308838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406455da-03ec-4099-abfd-496c15db9f05 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:00.320535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406455da-03ec-4099-abfd-496c15db9f05 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:00.489542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe026ccc-ad3e-46d4-aded-b2185f70285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:00.489896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe026ccc-ad3e-46d4-aded-b2185f70285b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.490172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe026ccc-ad3e-46d4-aded-b2185f70285b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.490455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe026ccc-ad3e-46d4-aded-b2185f70285b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.491143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe026ccc-ad3e-46d4-aded-b2185f70285b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:00.492875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe026ccc-ad3e-46d4-aded-b2185f70285b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:00.506318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1081/2188] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:00.510671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b608db-64ea-4a0f-be8d-dad968d26b47 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:00.526484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b608db-64ea-4a0f-be8d-dad968d26b47 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:00.546873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:00.547859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.548264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.548629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] PATH_INFO: `/v3/projects/3439ac21fe1345ac8302cbc0fbd7652f/users/e70af8345d4247f6aa702b5029da6f59/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.553391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3439ac21fe1345ac8302cbc0fbd7652f, user_id=e70af8345d4247f6aa702b5029da6f59, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:00.561717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:00.602890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1108/2189] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:00 2022] PUT /identity/v3/projects/3439ac21fe1345ac8302cbc0fbd7652f/users/e70af8345d4247f6aa702b5029da6f59/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:00.615164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9946-e9b1-4573-a96b-3c0723e54b22 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:00.615718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9946-e9b1-4573-a96b-3c0723e54b22 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:00.616224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d9946-e9b1-4573-a96b-3c0723e54b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:00.666914 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-343d9946-e9b1-4573-a96b-3c0723e54b22 None None] MFA Rules not processed for user `e70af8345d4247f6aa702b5029da6f59`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:00.672930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-343d9946-e9b1-4573-a96b-3c0723e54b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.728424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:00.877122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1082/2190] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:00.889575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:00.891898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:00.955571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:01.025322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacd426-5e72-47b5-afdc-e61d503c4ed5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:01.031061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57afa53-bc16-4ee7-92a1-c96f0ac6f41b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:01.031750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57afa53-bc16-4ee7-92a1-c96f0ac6f41b service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:01.032063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57afa53-bc16-4ee7-92a1-c96f0ac6f41b service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:01.032302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57afa53-bc16-4ee7-92a1-c96f0ac6f41b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:01.075441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57afa53-bc16-4ee7-92a1-c96f0ac6f41b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:01.077550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57afa53-bc16-4ee7-92a1-c96f0ac6f41b service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:01.111042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1109/2191] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:00 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:01.281791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55494b3-393c-463c-b403-629d9fd38922 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:01.281791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55494b3-393c-463c-b403-629d9fd38922 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:01.287996 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55494b3-393c-463c-b403-629d9fd38922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:01.355945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c55494b3-393c-463c-b403-629d9fd38922 None None] MFA Rules not processed for user `e520f1d390c94369b065721b32ba3131`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:01.357595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c55494b3-393c-463c-b403-629d9fd38922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:01.446618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57afa53-bc16-4ee7-92a1-c96f0ac6f41b service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:01.516641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1083/2192] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:01.652267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57afa53-bc16-4ee7-92a1-c96f0ac6f41b service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:01.717424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:01.718342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:01.718626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:01.719569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] PATH_INFO: `/v3/users/945100d825b64251a16b1c5c29e23f71` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:01.729169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=945100d825b64251a16b1c5c29e23f71)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:01.745203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:01.883484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945100d825b64251a16b1c5c29e23f71'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:01.895981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945100d825b64251a16b1c5c29e23f71'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:01.898212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945100d825b64251a16b1c5c29e23f71'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:01.900443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945100d825b64251a16b1c5c29e23f71'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:01.939493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945100d825b64251a16b1c5c29e23f71'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:01.972703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1110/2193] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:01 2022] DELETE /identity/v3/users/945100d825b64251a16b1c5c29e23f71 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:20:01.977248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652f45-f5a5-46f6-8688-1f9cd65d9776 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:01.977813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652f45-f5a5-46f6-8688-1f9cd65d9776 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:01.977986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652f45-f5a5-46f6-8688-1f9cd65d9776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:02.030413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c1652f45-f5a5-46f6-8688-1f9cd65d9776 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:02.034239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c1652f45-f5a5-46f6-8688-1f9cd65d9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:02.230984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1084/2194] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:02.299918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:02.301506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:02.510926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:02.535572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a59b01-c637-42dc-bb88-dcc4ab3c051d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:02.553834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df3f96-23df-4df8-9f30-f218fa0c4ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:02.556846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3f96-23df-4df8-9f30-f218fa0c4ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:02.557167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3f96-23df-4df8-9f30-f218fa0c4ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:02.557742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3f96-23df-4df8-9f30-f218fa0c4ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:02.590596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df3f96-23df-4df8-9f30-f218fa0c4ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:02.596487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df3f96-23df-4df8-9f30-f218fa0c4ed7 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:02.633601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1111/2195] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:03.442514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1652f45-f5a5-46f6-8688-1f9cd65d9776 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:03.444037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c1652f45-f5a5-46f6-8688-1f9cd65d9776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:03.469304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1652f45-f5a5-46f6-8688-1f9cd65d9776 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:03.497319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:03.498944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:03.499511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:03.499864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] PATH_INFO: `/v3/projects/59a127f865374643b461bff5fcde6aab` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:03.501867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a127f865374643b461bff5fcde6aab)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:03.505608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:03.626688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a127f865374643b461bff5fcde6aab', 'request_id': 'req-56bb7019-f57a-473b-aa6d-3b81faaf078b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:03.637171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a127f865374643b461bff5fcde6aab', 'request_id': 'req-56bb7019-f57a-473b-aa6d-3b81faaf078b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:03.642059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:03.657918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a127f865374643b461bff5fcde6aab', 'request_id': 'req-56bb7019-f57a-473b-aa6d-3b81faaf078b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:03.687096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] The token cache is being invalidate because project 59a127f865374643b461bff5fcde6aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:03.687543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:03.688368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:03.693662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1085/2196] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:03 2022] DELETE /identity/v3/projects/59a127f865374643b461bff5fcde6aab => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:03.694939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df3f96-23df-4df8-9f30-f218fa0c4ed7 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:03.710161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df3f96-23df-4df8-9f30-f218fa0c4ed7 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:03.951386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:03.952132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:03.952410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:03.952681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] PATH_INFO: `/v3/users/e70af8345d4247f6aa702b5029da6f59` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:03.953853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70af8345d4247f6aa702b5029da6f59)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:03.963255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:04.082833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70af8345d4247f6aa702b5029da6f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:04.103089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70af8345d4247f6aa702b5029da6f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:04.103966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70af8345d4247f6aa702b5029da6f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:04.104684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70af8345d4247f6aa702b5029da6f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:04.148749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-bd87b1c3-b80f-4733-bf47-7fc90260e710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70af8345d4247f6aa702b5029da6f59'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:04.182804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1112/2197] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:03 2022] DELETE /identity/v3/users/e70af8345d4247f6aa702b5029da6f59 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:04.917684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:04.921522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:04.948466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb7019-f57a-473b-aa6d-3b81faaf078b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:05.108226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:05.110556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:05.110939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:05.114212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] PATH_INFO: `/v3/projects/3439ac21fe1345ac8302cbc0fbd7652f` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:05.119171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3439ac21fe1345ac8302cbc0fbd7652f)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:05.121575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:05.286121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3439ac21fe1345ac8302cbc0fbd7652f', 'request_id': 'req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:05.320146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3439ac21fe1345ac8302cbc0fbd7652f', 'request_id': 'req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:05.344165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3439ac21fe1345ac8302cbc0fbd7652f', 'request_id': 'req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:05.379547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] The token cache is being invalidate because project 3439ac21fe1345ac8302cbc0fbd7652f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:05.385128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:05.391489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6b4a6c5c-6595-46bc-be4d-2c9a11fefb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:05.395289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1086/2198] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:04 2022] DELETE /identity/v3/projects/3439ac21fe1345ac8302cbc0fbd7652f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:05.399707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae5f1-af25-42d1-8d12-4f76bdcd7898 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:05.400929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae5f1-af25-42d1-8d12-4f76bdcd7898 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:05.401447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae5f1-af25-42d1-8d12-4f76bdcd7898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:05.500508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a20ae5f1-af25-42d1-8d12-4f76bdcd7898 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:05.503821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a20ae5f1-af25-42d1-8d12-4f76bdcd7898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:05.706487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1113/2199] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:05.729199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b616fb-9655-4d60-a21f-d1387da287a4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:05.729851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b616fb-9655-4d60-a21f-d1387da287a4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:05.730298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b616fb-9655-4d60-a21f-d1387da287a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:05.780695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-93b616fb-9655-4d60-a21f-d1387da287a4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:05.782472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-93b616fb-9655-4d60-a21f-d1387da287a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:05.839219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ae5f1-af25-42d1-8d12-4f76bdcd7898 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:05.844312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1087/2200] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:05.852605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ae5f1-af25-42d1-8d12-4f76bdcd7898 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:05.862685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:05.863353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:05.863636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:05.863916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:05.864581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:20:05.864987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:05.866475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:05.878064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:05.900569 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1114/2201] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:20:05.905558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b616fb-9655-4d60-a21f-d1387da287a4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:05.920804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b616fb-9655-4d60-a21f-d1387da287a4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:05.931170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2accd2-fc8e-40bb-a69d-97c7e70e94c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:05.932021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2accd2-fc8e-40bb-a69d-97c7e70e94c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:05.932470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2accd2-fc8e-40bb-a69d-97c7e70e94c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:05.932905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2accd2-fc8e-40bb-a69d-97c7e70e94c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:05.933840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2accd2-fc8e-40bb-a69d-97c7e70e94c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:05.951183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2accd2-fc8e-40bb-a69d-97c7e70e94c9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:06.015585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:06.022125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1088/2202] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:05 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:06.027822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fe17f-eef9-4f87-b1b5-39ada4f488be admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:06.184798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709834c9-6dde-4736-a2ff-d7b82bfbe4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:06.185745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709834c9-6dde-4736-a2ff-d7b82bfbe4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:06.186207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709834c9-6dde-4736-a2ff-d7b82bfbe4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:06.186681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709834c9-6dde-4736-a2ff-d7b82bfbe4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:06.187739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709834c9-6dde-4736-a2ff-d7b82bfbe4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:06.190127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709834c9-6dde-4736-a2ff-d7b82bfbe4b2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:06.248887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2accd2-fc8e-40bb-a69d-97c7e70e94c9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:06.257344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1115/2203] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:06 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:06.262161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2accd2-fc8e-40bb-a69d-97c7e70e94c9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:06.268966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b82a4-ade7-4c72-83a7-e3b4982f3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:06.270310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b82a4-ade7-4c72-83a7-e3b4982f3d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:06.270782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b82a4-ade7-4c72-83a7-e3b4982f3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:06.271288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b82a4-ade7-4c72-83a7-e3b4982f3d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:06.273512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b82a4-ade7-4c72-83a7-e3b4982f3d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:06.275721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b82a4-ade7-4c72-83a7-e3b4982f3d9b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:06.321136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709834c9-6dde-4736-a2ff-d7b82bfbe4b2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:06.322267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1089/2204] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:20:06.335834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709834c9-6dde-4736-a2ff-d7b82bfbe4b2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:06.349694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34c224-e007-4728-a6ed-fdfb0c379dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:06.350454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c224-e007-4728-a6ed-fdfb0c379dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:06.350804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c224-e007-4728-a6ed-fdfb0c379dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:06.351170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34c224-e007-4728-a6ed-fdfb0c379dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:06.351895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34c224-e007-4728-a6ed-fdfb0c379dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:06.360507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34c224-e007-4728-a6ed-fdfb0c379dbb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:06.385158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1116/2205] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:20:06.388444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b82a4-ade7-4c72-83a7-e3b4982f3d9b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:06.406528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b82a4-ade7-4c72-83a7-e3b4982f3d9b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:06.421648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bae39-3491-48a9-8361-54aee7ded4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:06.422339 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bae39-3491-48a9-8361-54aee7ded4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:06.422622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bae39-3491-48a9-8361-54aee7ded4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:06.423138 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bae39-3491-48a9-8361-54aee7ded4d9 admin admin] PATH_INFO: `/v3/projects/10b6584c0efb42f5877aafe17755ebab/users/3b1f5befecc64132b63e6d02807afb2e/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:06.473763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bae39-3491-48a9-8361-54aee7ded4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b6584c0efb42f5877aafe17755ebab, user_id=3b1f5befecc64132b63e6d02807afb2e, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:06.477022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bae39-3491-48a9-8361-54aee7ded4d9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:06.518776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1090/2206] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:06 2022] PUT /identity/v3/projects/10b6584c0efb42f5877aafe17755ebab/users/3b1f5befecc64132b63e6d02807afb2e/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:06.530101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593c74-3679-48cf-a4fa-ccf13e2b150d None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:06.530697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593c74-3679-48cf-a4fa-ccf13e2b150d None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:06.530697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593c74-3679-48cf-a4fa-ccf13e2b150d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:06.605301 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3c593c74-3679-48cf-a4fa-ccf13e2b150d None None] MFA Rules not processed for user `3b1f5befecc64132b63e6d02807afb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:06.606858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3c593c74-3679-48cf-a4fa-ccf13e2b150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:06.753995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1117/2207] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:06.758618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bae39-3491-48a9-8361-54aee7ded4d9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:06.782854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:06.941921 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bae39-3491-48a9-8361-54aee7ded4d9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:06.957032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744090f-5fd1-4d19-812a-958cc82bcaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:06.957497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744090f-5fd1-4d19-812a-958cc82bcaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:06.957958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744090f-5fd1-4d19-812a-958cc82bcaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:06.958552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744090f-5fd1-4d19-812a-958cc82bcaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:06.959983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744090f-5fd1-4d19-812a-958cc82bcaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:06.962215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744090f-5fd1-4d19-812a-958cc82bcaa5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:07.015202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1091/2208] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:06 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:20:07.021682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c593c74-3679-48cf-a4fa-ccf13e2b150d None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:07.045945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c593c74-3679-48cf-a4fa-ccf13e2b150d None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:07.172678 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d456d-ee86-4f28-88e4-ade31e2c6de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:07.173467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d456d-ee86-4f28-88e4-ade31e2c6de2 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.174575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d456d-ee86-4f28-88e4-ade31e2c6de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.174950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d456d-ee86-4f28-88e4-ade31e2c6de2 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.176467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d456d-ee86-4f28-88e4-ade31e2c6de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:07.181154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d456d-ee86-4f28-88e4-ade31e2c6de2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:07.195761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:07.242445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1118/2209] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:07 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:07.247093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744090f-5fd1-4d19-812a-958cc82bcaa5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:07.264250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744090f-5fd1-4d19-812a-958cc82bcaa5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:07.276220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfde57-2491-4c9c-8f44-1a14f2a78708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:07.277031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfde57-2491-4c9c-8f44-1a14f2a78708 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.277579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfde57-2491-4c9c-8f44-1a14f2a78708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.278048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfde57-2491-4c9c-8f44-1a14f2a78708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.279308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfde57-2491-4c9c-8f44-1a14f2a78708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:07.284032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfde57-2491-4c9c-8f44-1a14f2a78708 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:07.311206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1092/2210] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:07.315935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d456d-ee86-4f28-88e4-ade31e2c6de2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:07.334033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d456d-ee86-4f28-88e4-ade31e2c6de2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:07.348730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1980e-6bb2-4b0c-a36b-68dbc98c2efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:07.349717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1980e-6bb2-4b0c-a36b-68dbc98c2efa admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.350227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1980e-6bb2-4b0c-a36b-68dbc98c2efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.350662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1980e-6bb2-4b0c-a36b-68dbc98c2efa admin admin] PATH_INFO: `/v3/projects/413af59442ed4e35880d8acdd6267196/users/533d0c5f7250484996529697910a7403/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.393837 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1980e-6bb2-4b0c-a36b-68dbc98c2efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=413af59442ed4e35880d8acdd6267196, user_id=533d0c5f7250484996529697910a7403, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:07.397262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1980e-6bb2-4b0c-a36b-68dbc98c2efa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:07.425603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1119/2211] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:07 2022] PUT /identity/v3/projects/413af59442ed4e35880d8acdd6267196/users/533d0c5f7250484996529697910a7403/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:07.429680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfde57-2491-4c9c-8f44-1a14f2a78708 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:07.448776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfde57-2491-4c9c-8f44-1a14f2a78708 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:07.576926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8afeb-9f45-4077-9b54-bec873ddced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:07.580475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ed54-7cf2-4876-ae10-00d40f470e77 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.581547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ed54-7cf2-4876-ae10-00d40f470e77 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.582379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6ed54-7cf2-4876-ae10-00d40f470e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.584742 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8afeb-9f45-4077-9b54-bec873ddced3 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.588089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8afeb-9f45-4077-9b54-bec873ddced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.589078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8afeb-9f45-4077-9b54-bec873ddced3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.589955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8afeb-9f45-4077-9b54-bec873ddced3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:07.593748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8afeb-9f45-4077-9b54-bec873ddced3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:07.621603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1093/2212] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:07.627971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8afeb-9f45-4077-9b54-bec873ddced3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:07.652294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-15e6ed54-7cf2-4876-ae10-00d40f470e77 None None] MFA Rules not processed for user `f09f6b51114648fbbdc3126e597a0a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:07.654670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-15e6ed54-7cf2-4876-ae10-00d40f470e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:07.660682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8afeb-9f45-4077-9b54-bec873ddced3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:07.677534 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe5c74-f40c-4f95-849d-24eaa5e20bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:07.680299 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5c74-f40c-4f95-849d-24eaa5e20bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.681747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5c74-f40c-4f95-849d-24eaa5e20bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.682357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe5c74-f40c-4f95-849d-24eaa5e20bbd admin admin] PATH_INFO: `/v3/projects/413af59442ed4e35880d8acdd6267196/users/533d0c5f7250484996529697910a7403/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.687481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe5c74-f40c-4f95-849d-24eaa5e20bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=413af59442ed4e35880d8acdd6267196, user_id=533d0c5f7250484996529697910a7403, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:07.698171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe5c74-f40c-4f95-849d-24eaa5e20bbd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:07.743470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1094/2213] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:07 2022] PUT /identity/v3/projects/413af59442ed4e35880d8acdd6267196/users/533d0c5f7250484996529697910a7403/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:07.756178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcc944-edbf-4f35-883b-498bbbecf2a5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.758785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcc944-edbf-4f35-883b-498bbbecf2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.759321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcc944-edbf-4f35-883b-498bbbecf2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.806599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-28fcc944-edbf-4f35-883b-498bbbecf2a5 None None] MFA Rules not processed for user `533d0c5f7250484996529697910a7403`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:07.808911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-28fcc944-edbf-4f35-883b-498bbbecf2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:07.810726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1120/2214] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:07.814776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6ed54-7cf2-4876-ae10-00d40f470e77 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:07.816296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-15e6ed54-7cf2-4876-ae10-00d40f470e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:07.841625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6ed54-7cf2-4876-ae10-00d40f470e77 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:07.924196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850c10-96ee-4a60-bfda-d6d673750565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:07.925061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850c10-96ee-4a60-bfda-d6d673750565 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:07.925415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850c10-96ee-4a60-bfda-d6d673750565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:07.925802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850c10-96ee-4a60-bfda-d6d673750565 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:07.926554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00850c10-96ee-4a60-bfda-d6d673750565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:07.928808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00850c10-96ee-4a60-bfda-d6d673750565 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:08.018023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1121/2215] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:07 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:20:08.019138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850c10-96ee-4a60-bfda-d6d673750565 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:08.026562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:08.067471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1095/2216] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:08.079150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcc944-edbf-4f35-883b-498bbbecf2a5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:08.080688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-28fcc944-edbf-4f35-883b-498bbbecf2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:08.156392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:08.215722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcc944-edbf-4f35-883b-498bbbecf2a5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:08.223946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850c10-96ee-4a60-bfda-d6d673750565 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:08.233293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90a40a-0fda-4838-bf45-6dccafec11d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:08.234013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a40a-0fda-4838-bf45-6dccafec11d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:08.234300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a40a-0fda-4838-bf45-6dccafec11d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:08.234581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90a40a-0fda-4838-bf45-6dccafec11d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:08.235267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90a40a-0fda-4838-bf45-6dccafec11d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:08.237865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90a40a-0fda-4838-bf45-6dccafec11d9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:08.297555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1122/2217] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:08 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:08.319420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90a40a-0fda-4838-bf45-6dccafec11d9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:08.338667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90a40a-0fda-4838-bf45-6dccafec11d9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:08.349687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d918-b465-456d-a4cf-ae35a9ea2df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:08.351441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d918-b465-456d-a4cf-ae35a9ea2df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:08.351726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d918-b465-456d-a4cf-ae35a9ea2df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:08.352007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13d918-b465-456d-a4cf-ae35a9ea2df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:08.352693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d918-b465-456d-a4cf-ae35a9ea2df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:08.354862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13d918-b465-456d-a4cf-ae35a9ea2df0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:08.366313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715d90-a67f-41d0-ad0d-953f8f3193af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:08.369777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715d90-a67f-41d0-ad0d-953f8f3193af service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:08.373252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715d90-a67f-41d0-ad0d-953f8f3193af service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:08.373945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78715d90-a67f-41d0-ad0d-953f8f3193af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:08.399153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1123/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:08.399153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d918-b465-456d-a4cf-ae35a9ea2df0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:08.429362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13d918-b465-456d-a4cf-ae35a9ea2df0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:08.441817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5c32e-b2dc-42d8-9d40-22fc9324be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:08.442499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5c32e-b2dc-42d8-9d40-22fc9324be14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:08.442780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5c32e-b2dc-42d8-9d40-22fc9324be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:08.443133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5c32e-b2dc-42d8-9d40-22fc9324be14 admin admin] PATH_INFO: `/v3/projects/6b17107b79ac4035bfb9164b5aae4ccf/users/bd77b98bde964701aed2c2662e39e686/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:08.489878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5c32e-b2dc-42d8-9d40-22fc9324be14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b17107b79ac4035bfb9164b5aae4ccf, user_id=bd77b98bde964701aed2c2662e39e686, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:08.492653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5c32e-b2dc-42d8-9d40-22fc9324be14 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:08.510555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1124/2219] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:08 2022] PUT /identity/v3/projects/6b17107b79ac4035bfb9164b5aae4ccf/users/bd77b98bde964701aed2c2662e39e686/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:08.515226 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5c32e-b2dc-42d8-9d40-22fc9324be14 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:08.619258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78715d90-a67f-41d0-ad0d-953f8f3193af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:08.622891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78715d90-a67f-41d0-ad0d-953f8f3193af service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:08.648961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1096/2220] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:08 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:20:08.677304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5c32e-b2dc-42d8-9d40-22fc9324be14 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:08.701403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c90e-bded-4f03-85ca-35dd84200ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:08.705306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c90e-bded-4f03-85ca-35dd84200ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:08.705597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c90e-bded-4f03-85ca-35dd84200ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:08.705880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c90e-bded-4f03-85ca-35dd84200ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:08.706570 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024c90e-bded-4f03-85ca-35dd84200ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:08.708226 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024c90e-bded-4f03-85ca-35dd84200ae4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:08.765392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1125/2221] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:08.766676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715d90-a67f-41d0-ad0d-953f8f3193af service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:08.787800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78715d90-a67f-41d0-ad0d-953f8f3193af service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:08.803048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548bab2-02ac-418a-b25a-6d5c35538656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:08.803483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548bab2-02ac-418a-b25a-6d5c35538656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:08.803896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548bab2-02ac-418a-b25a-6d5c35538656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:08.804122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548bab2-02ac-418a-b25a-6d5c35538656 admin admin] PATH_INFO: `/v3/projects/6b17107b79ac4035bfb9164b5aae4ccf/users/bd77b98bde964701aed2c2662e39e686/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:08.807833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548bab2-02ac-418a-b25a-6d5c35538656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b17107b79ac4035bfb9164b5aae4ccf, user_id=bd77b98bde964701aed2c2662e39e686, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:08.817343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548bab2-02ac-418a-b25a-6d5c35538656 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:08.841519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c90e-bded-4f03-85ca-35dd84200ae4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:08.858123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1097/2222] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:08 2022] PUT /identity/v3/projects/6b17107b79ac4035bfb9164b5aae4ccf/users/bd77b98bde964701aed2c2662e39e686/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:09.098983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c90e-bded-4f03-85ca-35dd84200ae4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:09.223368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700a11b-1006-4916-9ef6-032474659d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:09.224347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a11b-1006-4916-9ef6-032474659d2d service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:09.224730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a11b-1006-4916-9ef6-032474659d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:09.225105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a11b-1006-4916-9ef6-032474659d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:09.230179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:09.331291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700a11b-1006-4916-9ef6-032474659d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:09.332847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700a11b-1006-4916-9ef6-032474659d2d service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:09.357597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1126/2223] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:18.721543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548bab2-02ac-418a-b25a-6d5c35538656 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:18.851412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:18.878046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548bab2-02ac-418a-b25a-6d5c35538656 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:18.893552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:18.894216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:18.894500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:18.894779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] PATH_INFO: `/v3/users/3b1f5befecc64132b63e6d02807afb2e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:18.896380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1f5befecc64132b63e6d02807afb2e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:18.898627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:19.001964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1f5befecc64132b63e6d02807afb2e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:19.014329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1f5befecc64132b63e6d02807afb2e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:19.019763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1f5befecc64132b63e6d02807afb2e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:19.020715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1f5befecc64132b63e6d02807afb2e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:19.029891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1f5befecc64132b63e6d02807afb2e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:19.074465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1098/2224] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:18 2022] DELETE /identity/v3/users/3b1f5befecc64132b63e6d02807afb2e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:19.079676 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052895dd-1675-4f9c-8570-c267fc902cb0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:19.080210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052895dd-1675-4f9c-8570-c267fc902cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:19.080210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052895dd-1675-4f9c-8570-c267fc902cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:19.134486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-052895dd-1675-4f9c-8570-c267fc902cb0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:19.137232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-052895dd-1675-4f9c-8570-c267fc902cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:19.269802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1127/2225] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:19.290618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:19.292213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:19.418214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce2ca4-e1e0-4c12-abdc-d6e3bee3d0c5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:19.440332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1875c5-2a18-4fdf-ba1e-902a88cb9992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:19.441295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1875c5-2a18-4fdf-ba1e-902a88cb9992 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:19.441788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1875c5-2a18-4fdf-ba1e-902a88cb9992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:19.442263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1875c5-2a18-4fdf-ba1e-902a88cb9992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:19.462919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1875c5-2a18-4fdf-ba1e-902a88cb9992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:19.464636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1875c5-2a18-4fdf-ba1e-902a88cb9992 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:19.487547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1099/2226] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:19.767875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052895dd-1675-4f9c-8570-c267fc902cb0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:19.770361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-052895dd-1675-4f9c-8570-c267fc902cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:19.821978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052895dd-1675-4f9c-8570-c267fc902cb0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:19.835102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:19.835769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:19.836047 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:19.836321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] PATH_INFO: `/v3/users/28f840eb92834e7eb976778886267012` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:19.850632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f840eb92834e7eb976778886267012)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:19.852615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:20.006433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f840eb92834e7eb976778886267012'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.047917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f840eb92834e7eb976778886267012'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.048793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f840eb92834e7eb976778886267012'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.049538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f840eb92834e7eb976778886267012'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.079145 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f840eb92834e7eb976778886267012'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.139556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1128/2227] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:19 2022] DELETE /identity/v3/users/28f840eb92834e7eb976778886267012 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:20.512098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b321de8-66f1-4ade-a799-d8297bb9f8f3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:20.513127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b321de8-66f1-4ade-a799-d8297bb9f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:20.513348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b321de8-66f1-4ade-a799-d8297bb9f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:20.557681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:20.560105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:20.573820 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0b321de8-66f1-4ade-a799-d8297bb9f8f3 None None] MFA Rules not processed for user `bd77b98bde964701aed2c2662e39e686`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:20.575836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0b321de8-66f1-4ade-a799-d8297bb9f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:20.610290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:20.703636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:20.724361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1100/2228] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:20.727263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b321de8-66f1-4ade-a799-d8297bb9f8f3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:20.728676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0b321de8-66f1-4ade-a799-d8297bb9f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:20.748243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b321de8-66f1-4ade-a799-d8297bb9f8f3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:20.752927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b12491-995c-4704-ae01-7ba4f9564e7c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:20.754645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:20.755558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:20.756662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:20.757089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] PATH_INFO: `/v3/projects/bbb290f5b71b452e8efd2ae4e730423c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:20.758682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb290f5b71b452e8efd2ae4e730423c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:20.762750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:20.773356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:20.774019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:20.774305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:20.774580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] PATH_INFO: `/v3/projects/10b6584c0efb42f5877aafe17755ebab` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:20.777735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b6584c0efb42f5877aafe17755ebab)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:20.784713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:20.885524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b6584c0efb42f5877aafe17755ebab', 'request_id': 'req-c961472a-72ed-456d-9811-7c98889ab077'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.888016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb290f5b71b452e8efd2ae4e730423c', 'request_id': 'req-4711f390-5d1f-4c23-b855-96d2a5addda7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.900412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb290f5b71b452e8efd2ae4e730423c', 'request_id': 'req-4711f390-5d1f-4c23-b855-96d2a5addda7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.907624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b6584c0efb42f5877aafe17755ebab', 'request_id': 'req-c961472a-72ed-456d-9811-7c98889ab077'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.912420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb290f5b71b452e8efd2ae4e730423c', 'request_id': 'req-4711f390-5d1f-4c23-b855-96d2a5addda7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.935728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] The token cache is being invalidate because project bbb290f5b71b452e8efd2ae4e730423c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:20.936452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.937533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.939755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1101/2229] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:20 2022] DELETE /identity/v3/projects/bbb290f5b71b452e8efd2ae4e730423c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:20.941995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b6584c0efb42f5877aafe17755ebab', 'request_id': 'req-c961472a-72ed-456d-9811-7c98889ab077'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.961301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:20.964570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:20.977409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] The token cache is being invalidate because project 10b6584c0efb42f5877aafe17755ebab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:20.977793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.979538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:20.982204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1129/2230] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:20 2022] DELETE /identity/v3/projects/10b6584c0efb42f5877aafe17755ebab => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:20.985107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:20.987609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:21.081730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961472a-72ed-456d-9811-7c98889ab077 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:21.101262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711f390-5d1f-4c23-b855-96d2a5addda7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:21.110389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:21.111050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:21.111337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:21.111610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:21.114439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:21.170877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:21.182230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:21.184451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:21.184856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:21.185116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] PATH_INFO: `/v3/users/02f9f388c16748c086f09f20e4853d47` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:21.186799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f9f388c16748c086f09f20e4853d47)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:21.189409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:21.229263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:21.232014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:21.243143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1102/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:21.244334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:21.247437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:21.254680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f9f388c16748c086f09f20e4853d47'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.267536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ef0e-7183-4004-b750-4b8626c67c37 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:21.271150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f9f388c16748c086f09f20e4853d47'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.275178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f9f388c16748c086f09f20e4853d47'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.277407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f9f388c16748c086f09f20e4853d47'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.288128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:21.288781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:21.289050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:21.289591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] PATH_INFO: `/v3/users/533d0c5f7250484996529697910a7403` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:21.290520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533d0c5f7250484996529697910a7403)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:21.292680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:21.321356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f9f388c16748c086f09f20e4853d47'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.330322 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:21.396441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1130/2232] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:20 2022] DELETE /identity/v3/users/02f9f388c16748c086f09f20e4853d47 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:21.425087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533d0c5f7250484996529697910a7403'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.447697 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533d0c5f7250484996529697910a7403'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.452033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533d0c5f7250484996529697910a7403'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.452741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533d0c5f7250484996529697910a7403'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.467929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533d0c5f7250484996529697910a7403'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:21.501550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1103/2233] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:21 2022] DELETE /identity/v3/users/533d0c5f7250484996529697910a7403 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:22.241102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:22.242757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:22.400110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:22.402485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:22.411576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd27db3-daf4-4f18-9f81-83538742921c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:22.550692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:22.551297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:22.551582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:22.551860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] PATH_INFO: `/v3/projects/6991df538a574a43b60bd77ae9db0432` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:22.554368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6991df538a574a43b60bd77ae9db0432)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:22.556337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:22.574974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981c57b-33ec-4dba-9764-5a2b0b040496 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:22.586286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:22.587031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:22.587322 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:22.587602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] PATH_INFO: `/v3/projects/413af59442ed4e35880d8acdd6267196` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:22.590809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] RBAC: Authorizing `identity:delete_project(project_id=413af59442ed4e35880d8acdd6267196)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:22.592754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:22.640391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:22.680878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '413af59442ed4e35880d8acdd6267196', 'request_id': 'req-1f5683c1-077e-4893-9867-60b5f219c49e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.684110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6991df538a574a43b60bd77ae9db0432', 'request_id': 'req-4baf6964-b81e-47a1-b277-665cc21f77b2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.690704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '413af59442ed4e35880d8acdd6267196', 'request_id': 'req-1f5683c1-077e-4893-9867-60b5f219c49e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.696010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6991df538a574a43b60bd77ae9db0432', 'request_id': 'req-4baf6964-b81e-47a1-b277-665cc21f77b2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.704908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '413af59442ed4e35880d8acdd6267196', 'request_id': 'req-1f5683c1-077e-4893-9867-60b5f219c49e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.716476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6991df538a574a43b60bd77ae9db0432', 'request_id': 'req-4baf6964-b81e-47a1-b277-665cc21f77b2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.720187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] The token cache is being invalidate because project 413af59442ed4e35880d8acdd6267196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:22.721030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.721922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f5683c1-077e-4893-9867-60b5f219c49e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.723931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1104/2234] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:22 2022] DELETE /identity/v3/projects/413af59442ed4e35880d8acdd6267196 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:20:22.729321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c714f-eb3d-4156-9386-9f853d358c98 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:22.731596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c714f-eb3d-4156-9386-9f853d358c98 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:22.732225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c714f-eb3d-4156-9386-9f853d358c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:22.753224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] The token cache is being invalidate because project 6991df538a574a43b60bd77ae9db0432 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:22.753532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.756921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-4baf6964-b81e-47a1-b277-665cc21f77b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:22.761197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1131/2235] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:22 2022] DELETE /identity/v3/projects/6991df538a574a43b60bd77ae9db0432 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:22.768388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed5c8-369e-4f28-98d0-3e99fd687a5f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:22.768679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed5c8-369e-4f28-98d0-3e99fd687a5f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:22.769107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbed5c8-369e-4f28-98d0-3e99fd687a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:22.773861 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-401c714f-eb3d-4156-9386-9f853d358c98 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:22.775135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-401c714f-eb3d-4156-9386-9f853d358c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:22.812528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:22.824675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0fbed5c8-369e-4f28-98d0-3e99fd687a5f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:22.828753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0fbed5c8-369e-4f28-98d0-3e99fd687a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:22.941763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1105/2236] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:22.952240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964a49-5b92-4207-98cf-f71eec4e1410 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:22.952546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964a49-5b92-4207-98cf-f71eec4e1410 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:22.952802 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964a49-5b92-4207-98cf-f71eec4e1410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.001369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1132/2237] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:23.004805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a2964a49-5b92-4207-98cf-f71eec4e1410 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:23.006444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a2964a49-5b92-4207-98cf-f71eec4e1410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:23.010970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa793-7509-46d9-ac08-22508c872c03 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.011284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa793-7509-46d9-ac08-22508c872c03 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.011560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21fa793-7509-46d9-ac08-22508c872c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.041420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1106/2238] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:23.045756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2964a49-5b92-4207-98cf-f71eec4e1410 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.079769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c21fa793-7509-46d9-ac08-22508c872c03 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:23.081983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2964a49-5b92-4207-98cf-f71eec4e1410 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.084244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c21fa793-7509-46d9-ac08-22508c872c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:23.097266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.098230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.098691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.099198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.100307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:20:23.100923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.103511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.103791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1133/2239] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:23.108095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fa793-7509-46d9-ac08-22508c872c03 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.124812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21fa793-7509-46d9-ac08-22508c872c03 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.130635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.131473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.132256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1107/2240] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:20:23.137798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.139048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.140313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:20:23.140865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.141269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.144820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.165484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d500e6-5e20-43df-b6ef-3dccd56f84bb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.183199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b47b11-c0c4-47cd-a95e-9187f6b5e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.183892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b47b11-c0c4-47cd-a95e-9187f6b5e9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.184180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b47b11-c0c4-47cd-a95e-9187f6b5e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.184454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b47b11-c0c4-47cd-a95e-9187f6b5e9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.185100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b47b11-c0c4-47cd-a95e-9187f6b5e9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.187221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b47b11-c0c4-47cd-a95e-9187f6b5e9f3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.200625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1134/2241] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:20:23.201612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.229372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ff4f-648a-4406-9bb9-593d89a0677d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.246573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745c75b-d002-449f-8c3e-970fd1d5b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.247330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c75b-d002-449f-8c3e-970fd1d5b703 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.247566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c75b-d002-449f-8c3e-970fd1d5b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.247776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1108/2242] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:23 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:23.247996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745c75b-d002-449f-8c3e-970fd1d5b703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.248649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c75b-d002-449f-8c3e-970fd1d5b703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.253743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b47b11-c0c4-47cd-a95e-9187f6b5e9f3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.254180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745c75b-d002-449f-8c3e-970fd1d5b703 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.350803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1135/2243] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:23 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:23.350803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745c75b-d002-449f-8c3e-970fd1d5b703 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.511827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b47b11-c0c4-47cd-a95e-9187f6b5e9f3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.597140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745c75b-d002-449f-8c3e-970fd1d5b703 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.611225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6816285-3450-476d-8c06-529aab75d357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.613880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6816285-3450-476d-8c06-529aab75d357 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.614549 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6816285-3450-476d-8c06-529aab75d357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.615966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6816285-3450-476d-8c06-529aab75d357 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.617302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6816285-3450-476d-8c06-529aab75d357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.623040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6816285-3450-476d-8c06-529aab75d357 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.647982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:23.663893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1136/2244] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:23 2022] POST /identity/v3/users => generated 287 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:23.665379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6816285-3450-476d-8c06-529aab75d357 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.684493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6816285-3450-476d-8c06-529aab75d357 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.687152 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ebedf-cbe6-4554-8d80-be32ea046247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.688033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebedf-cbe6-4554-8d80-be32ea046247 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.688533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebedf-cbe6-4554-8d80-be32ea046247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.689014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebedf-cbe6-4554-8d80-be32ea046247 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.689867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ebedf-cbe6-4554-8d80-be32ea046247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.692277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ebedf-cbe6-4554-8d80-be32ea046247 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.698495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaafe6-57f5-41b3-b80b-143447214685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.698700 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaafe6-57f5-41b3-b80b-143447214685 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.698947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaafe6-57f5-41b3-b80b-143447214685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.699249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaafe6-57f5-41b3-b80b-143447214685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.699954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaafe6-57f5-41b3-b80b-143447214685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.701552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaafe6-57f5-41b3-b80b-143447214685 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.726427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1137/2245] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:23.730401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaafe6-57f5-41b3-b80b-143447214685 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.751836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1109/2246] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:23 2022] POST /identity/v3/users => generated 283 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:23.752883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaafe6-57f5-41b3-b80b-143447214685 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.755826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ebedf-cbe6-4554-8d80-be32ea046247 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.767829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab926875-238d-44f6-9235-b9d7561f9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.769141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab926875-238d-44f6-9235-b9d7561f9fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.769489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab926875-238d-44f6-9235-b9d7561f9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.769723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab926875-238d-44f6-9235-b9d7561f9fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.772888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab926875-238d-44f6-9235-b9d7561f9fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.775346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab926875-238d-44f6-9235-b9d7561f9fa1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.780872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ebedf-cbe6-4554-8d80-be32ea046247 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.795316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1138/2247] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:23.795868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33d905-b6e1-45da-aac6-f868fc4400d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.796497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33d905-b6e1-45da-aac6-f868fc4400d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.796781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33d905-b6e1-45da-aac6-f868fc4400d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.797062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33d905-b6e1-45da-aac6-f868fc4400d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.797722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33d905-b6e1-45da-aac6-f868fc4400d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.799344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33d905-b6e1-45da-aac6-f868fc4400d7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.807739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab926875-238d-44f6-9235-b9d7561f9fa1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.825097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab926875-238d-44f6-9235-b9d7561f9fa1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.836501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1110/2248] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:23.836722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b499b-adcc-4fe5-ba3b-40621ae62eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.837484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b499b-adcc-4fe5-ba3b-40621ae62eae admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.837765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b499b-adcc-4fe5-ba3b-40621ae62eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.838043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b499b-adcc-4fe5-ba3b-40621ae62eae admin admin] PATH_INFO: `/v3/projects/11b1f39aa083443f9cb31659c98314eb/users/fb30b8449d114e289c36c091f1217b69/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.841941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33d905-b6e1-45da-aac6-f868fc4400d7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.852219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:23.879847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33d905-b6e1-45da-aac6-f868fc4400d7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.879847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5548b9a-e5ce-430d-973f-650cc15a39c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:23.879847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548b9a-e5ce-430d-973f-650cc15a39c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.880144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548b9a-e5ce-430d-973f-650cc15a39c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.880390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5548b9a-e5ce-430d-973f-650cc15a39c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.881659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5548b9a-e5ce-430d-973f-650cc15a39c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.890883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5548b9a-e5ce-430d-973f-650cc15a39c1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.911997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b499b-adcc-4fe5-ba3b-40621ae62eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b1f39aa083443f9cb31659c98314eb, user_id=fb30b8449d114e289c36c091f1217b69, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:23.915084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b499b-adcc-4fe5-ba3b-40621ae62eae admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:23.928293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1111/2249] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:23.940201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5548b9a-e5ce-430d-973f-650cc15a39c1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:23.955623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1139/2250] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:23 2022] PUT /identity/v3/projects/11b1f39aa083443f9cb31659c98314eb/users/fb30b8449d114e289c36c091f1217b69/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:23.958486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a443-21eb-4861-b8b4-6d5aa705847f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:23.959003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a443-21eb-4861-b8b4-6d5aa705847f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:23.960502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709a443-21eb-4861-b8b4-6d5aa705847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:23.966354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5548b9a-e5ce-430d-973f-650cc15a39c1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:23.990923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0709a443-21eb-4861-b8b4-6d5aa705847f None None] MFA Rules not processed for user `f09f6b51114648fbbdc3126e597a0a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:23.992597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0709a443-21eb-4861-b8b4-6d5aa705847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:24.088107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1140/2251] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:24.089409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec63be3-41ff-4acf-b676-9817098992c1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:24.090044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec63be3-41ff-4acf-b676-9817098992c1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:24.090852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec63be3-41ff-4acf-b676-9817098992c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:24.124597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-dec63be3-41ff-4acf-b676-9817098992c1 None None] MFA Rules not processed for user `fb30b8449d114e289c36c091f1217b69`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:24.125967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-dec63be3-41ff-4acf-b676-9817098992c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:24.141718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:24.142530 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:24.142836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:24.143527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] PATH_INFO: `/v3/projects/5ef26ec3ca1d423e9bc634c069abd7cb/users/d6a0d44723ad48f5842f595ae6d26778/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:24.200677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef26ec3ca1d423e9bc634c069abd7cb, user_id=d6a0d44723ad48f5842f595ae6d26778, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:24.221920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:24.266973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1141/2252] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:24.275165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1112/2253] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:23 2022] PUT /identity/v3/projects/5ef26ec3ca1d423e9bc634c069abd7cb/users/d6a0d44723ad48f5842f595ae6d26778/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:24.286879 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07409-5bcf-4dd7-80e4-dcf08c049aa9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:24.287718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07409-5bcf-4dd7-80e4-dcf08c049aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:24.288347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07409-5bcf-4dd7-80e4-dcf08c049aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:24.290834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:24.293045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:24.371931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-84a07409-5bcf-4dd7-80e4-dcf08c049aa9 None None] MFA Rules not processed for user `d6a0d44723ad48f5842f595ae6d26778`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:24.378582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-84a07409-5bcf-4dd7-80e4-dcf08c049aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:24.534206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:24.540136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09faf4b2-5409-415b-a704-b73b5f0e077f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:24.549936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa9887-4985-4694-85bb-10883c5db285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:24.551296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa9887-4985-4694-85bb-10883c5db285 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:24.552442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa9887-4985-4694-85bb-10883c5db285 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:24.552990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa9887-4985-4694-85bb-10883c5db285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:24.596134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1142/2254] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:24.597466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a07409-5bcf-4dd7-80e4-dcf08c049aa9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:24.714251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa9887-4985-4694-85bb-10883c5db285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:24.718760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa9887-4985-4694-85bb-10883c5db285 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:24.741024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1113/2255] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:24.787858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa9887-4985-4694-85bb-10883c5db285 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:24.866826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a07409-5bcf-4dd7-80e4-dcf08c049aa9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:24.888404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ea746-1bc0-4021-b669-83ea3b175be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:24.889104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ea746-1bc0-4021-b669-83ea3b175be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:24.889387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ea746-1bc0-4021-b669-83ea3b175be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:24.889662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ea746-1bc0-4021-b669-83ea3b175be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:24.890312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ea746-1bc0-4021-b669-83ea3b175be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:24.894548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:24.905104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ea746-1bc0-4021-b669-83ea3b175be6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:25.005243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1143/2256] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:24 2022] POST /identity/v3/projects => generated 363 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:25.006477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ea746-1bc0-4021-b669-83ea3b175be6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:25.026786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa9887-4985-4694-85bb-10883c5db285 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:25.214914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ea746-1bc0-4021-b669-83ea3b175be6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:25.231061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92473bbe-2ab8-4a6d-9654-ba04ac951b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:25.232033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473bbe-2ab8-4a6d-9654-ba04ac951b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.232194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473bbe-2ab8-4a6d-9654-ba04ac951b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.237960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92473bbe-2ab8-4a6d-9654-ba04ac951b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.238662 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473bbe-2ab8-4a6d-9654-ba04ac951b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:25.241256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92473bbe-2ab8-4a6d-9654-ba04ac951b1e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:25.257794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:25.258702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.260537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.261044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] PATH_INFO: `/v3/users/fb30b8449d114e289c36c091f1217b69` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.263418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb30b8449d114e289c36c091f1217b69)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:25.273964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:25.304869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1144/2257] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:25 2022] POST /identity/v3/users => generated 288 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:25.310938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92473bbe-2ab8-4a6d-9654-ba04ac951b1e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:25.390531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92473bbe-2ab8-4a6d-9654-ba04ac951b1e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:25.406044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8495e-8fe6-4d4d-9669-ae60c948c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:25.407937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8495e-8fe6-4d4d-9669-ae60c948c081 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.408230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8495e-8fe6-4d4d-9669-ae60c948c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.408505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8495e-8fe6-4d4d-9669-ae60c948c081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.411401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8495e-8fe6-4d4d-9669-ae60c948c081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:25.414267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8495e-8fe6-4d4d-9669-ae60c948c081 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:25.435674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb30b8449d114e289c36c091f1217b69'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:25.446817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1145/2258] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:25.447801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8495e-8fe6-4d4d-9669-ae60c948c081 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:25.450602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb30b8449d114e289c36c091f1217b69'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:25.451372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb30b8449d114e289c36c091f1217b69'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:25.452020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb30b8449d114e289c36c091f1217b69'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:25.461652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5c58853a-3154-4749-8066-eab30d4a16b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb30b8449d114e289c36c091f1217b69'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:25.468548 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8495e-8fe6-4d4d-9669-ae60c948c081 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:25.477023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:25.477881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.478163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.478466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] PATH_INFO: `/v3/projects/c4e7c358fa264855bc9fa3cc9c91ac6d/users/99a6f19b10974bd3a5cdc75ee4eac7cf/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.495397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1114/2259] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:24 2022] DELETE /identity/v3/users/fb30b8449d114e289c36c091f1217b69 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:20:25.502356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2345-2eff-494c-9652-dcaf30a972a8 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.502876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2345-2eff-494c-9652-dcaf30a972a8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.503215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2345-2eff-494c-9652-dcaf30a972a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.523651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e7c358fa264855bc9fa3cc9c91ac6d, user_id=99a6f19b10974bd3a5cdc75ee4eac7cf, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:25.527036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:25.530080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9afc2345-2eff-494c-9652-dcaf30a972a8 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:25.532208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9afc2345-2eff-494c-9652-dcaf30a972a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:25.560901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1146/2260] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:25 2022] PUT /identity/v3/projects/c4e7c358fa264855bc9fa3cc9c91ac6d/users/99a6f19b10974bd3a5cdc75ee4eac7cf/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:25.561865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:25.577154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:25.600975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:25.616393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:25.638576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1115/2261] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:25.645806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2345-2eff-494c-9652-dcaf30a972a8 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:25.650304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9afc2345-2eff-494c-9652-dcaf30a972a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:25.673339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea166d-6952-4394-af71-3d4404482ff1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:25.684272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8619f3-9efd-4a8c-91ea-a50418dedd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:25.684996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8619f3-9efd-4a8c-91ea-a50418dedd2a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.685354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8619f3-9efd-4a8c-91ea-a50418dedd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.685811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8619f3-9efd-4a8c-91ea-a50418dedd2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.687140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8619f3-9efd-4a8c-91ea-a50418dedd2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:25.689097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8619f3-9efd-4a8c-91ea-a50418dedd2a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:25.703048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1147/2262] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:25.703048 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50e13-a18d-4fb8-bf60-49bef60edc4c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.703579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50e13-a18d-4fb8-bf60-49bef60edc4c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.704105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb50e13-a18d-4fb8-bf60-49bef60edc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.726853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6bb50e13-a18d-4fb8-bf60-49bef60edc4c None None] MFA Rules not processed for user `ecafbe3f3e4f4e1d84b7443b9877292c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:25.728919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6bb50e13-a18d-4fb8-bf60-49bef60edc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:25.739096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2345-2eff-494c-9652-dcaf30a972a8 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:25.808769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1148/2263] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:25.817706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb50e13-a18d-4fb8-bf60-49bef60edc4c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:25.850350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb50e13-a18d-4fb8-bf60-49bef60edc4c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:25.853883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:25.854672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.855137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.856180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.863304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaba95b-f82b-4a7e-81d9-c3febe4a7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:25.864044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba95b-f82b-4a7e-81d9-c3febe4a7c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.864283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba95b-f82b-4a7e-81d9-c3febe4a7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.864602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaba95b-f82b-4a7e-81d9-c3febe4a7c58 admin admin] PATH_INFO: `/v3/projects/c4e7c358fa264855bc9fa3cc9c91ac6d/users/99a6f19b10974bd3a5cdc75ee4eac7cf/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.868647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaba95b-f82b-4a7e-81d9-c3febe4a7c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e7c358fa264855bc9fa3cc9c91ac6d, user_id=99a6f19b10974bd3a5cdc75ee4eac7cf, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:25.872784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:25.874695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaba95b-f82b-4a7e-81d9-c3febe4a7c58 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:25.874818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:25.892213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1149/2264] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:25 2022] PUT /identity/v3/projects/c4e7c358fa264855bc9fa3cc9c91ac6d/users/99a6f19b10974bd3a5cdc75ee4eac7cf/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:25.897497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1116/2265] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:25.903013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49ed1-c996-4e43-aa22-cf6fcf5facc7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:25.903424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49ed1-c996-4e43-aa22-cf6fcf5facc7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:25.903803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad49ed1-c996-4e43-aa22-cf6fcf5facc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:25.948508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4ad49ed1-c996-4e43-aa22-cf6fcf5facc7 None None] MFA Rules not processed for user `99a6f19b10974bd3a5cdc75ee4eac7cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:25.950073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4ad49ed1-c996-4e43-aa22-cf6fcf5facc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:26.088085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1150/2266] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:26.100614 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:26.104607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:26.223276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52863f03-82e6-4349-ab01-5afe955f0022 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:26.296440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed713f7a-aed9-4947-a9d6-5bd052bbed94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:26.297073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed713f7a-aed9-4947-a9d6-5bd052bbed94 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:26.297356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed713f7a-aed9-4947-a9d6-5bd052bbed94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:26.297632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed713f7a-aed9-4947-a9d6-5bd052bbed94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:26.310927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed713f7a-aed9-4947-a9d6-5bd052bbed94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:26.312850 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed713f7a-aed9-4947-a9d6-5bd052bbed94 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:26.328542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1117/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:26.378844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad49ed1-c996-4e43-aa22-cf6fcf5facc7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:26.385553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4ad49ed1-c996-4e43-aa22-cf6fcf5facc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:26.483603 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:26.493707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed713f7a-aed9-4947-a9d6-5bd052bbed94 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:26.507784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed713f7a-aed9-4947-a9d6-5bd052bbed94 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:26.523661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835fdb-19c6-4c49-bd99-e3c59a648039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:26.524659 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835fdb-19c6-4c49-bd99-e3c59a648039 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:26.524949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835fdb-19c6-4c49-bd99-e3c59a648039 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:26.525351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835fdb-19c6-4c49-bd99-e3c59a648039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:26.537988 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f9835fdb-19c6-4c49-bd99-e3c59a648039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:26.545355 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad49ed1-c996-4e43-aa22-cf6fcf5facc7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:26.559896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:26.560557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:26.560897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:26.561182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] PATH_INFO: `/v3/projects/11b1f39aa083443f9cb31659c98314eb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:26.562402 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b1f39aa083443f9cb31659c98314eb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:26.564475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:26.584045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:26.656384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b1f39aa083443f9cb31659c98314eb', 'request_id': 'req-d2bac670-d977-44b9-8e25-6c1efee4b7c4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:26.669704 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b1f39aa083443f9cb31659c98314eb', 'request_id': 'req-d2bac670-d977-44b9-8e25-6c1efee4b7c4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:26.671386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9835fdb-19c6-4c49-bd99-e3c59a648039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:26.672879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9835fdb-19c6-4c49-bd99-e3c59a648039 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:26.694065 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1118/2268] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:20:26.701312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b1f39aa083443f9cb31659c98314eb', 'request_id': 'req-d2bac670-d977-44b9-8e25-6c1efee4b7c4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:26.727530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] The token cache is being invalidate because project 11b1f39aa083443f9cb31659c98314eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:26.728626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:26.729725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d2bac670-d977-44b9-8e25-6c1efee4b7c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:26.737439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1151/2269] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:26 2022] DELETE /identity/v3/projects/11b1f39aa083443f9cb31659c98314eb => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:26.740852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381cc0-f82e-455f-9c78-4eac3d8800bd None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:26.741159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381cc0-f82e-455f-9c78-4eac3d8800bd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:26.741448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381cc0-f82e-455f-9c78-4eac3d8800bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:26.787313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ce381cc0-f82e-455f-9c78-4eac3d8800bd None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:26.789056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ce381cc0-f82e-455f-9c78-4eac3d8800bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:26.971552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1119/2270] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:26.979161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31344a9-8687-4f74-88e4-9f0590a59fd9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:26.979533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31344a9-8687-4f74-88e4-9f0590a59fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:26.979895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31344a9-8687-4f74-88e4-9f0590a59fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.015380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a31344a9-8687-4f74-88e4-9f0590a59fd9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:27.016747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a31344a9-8687-4f74-88e4-9f0590a59fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:27.031884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1152/2271] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:27.033227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381cc0-f82e-455f-9c78-4eac3d8800bd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:27.046342 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381cc0-f82e-455f-9c78-4eac3d8800bd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:27.058047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:27.059886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:27.060180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:27.060452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.061124 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:20:27.061440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:27.063131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:27.083081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1120/2272] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:20:27.085815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31344a9-8687-4f74-88e4-9f0590a59fd9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:27.097191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31344a9-8687-4f74-88e4-9f0590a59fd9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:27.103197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bc7b0-a3b8-4bb2-8f54-2c74d70b4401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:27.103938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc7b0-a3b8-4bb2-8f54-2c74d70b4401 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:27.104307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc7b0-a3b8-4bb2-8f54-2c74d70b4401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:27.104631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bc7b0-a3b8-4bb2-8f54-2c74d70b4401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.105280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bc7b0-a3b8-4bb2-8f54-2c74d70b4401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:27.108137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bc7b0-a3b8-4bb2-8f54-2c74d70b4401 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:27.140054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1153/2273] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:27 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:27.144337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:27.156834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52626df-a05e-486e-8ce8-7b828c5ea477 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:27.228684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd437c5-f8de-44cd-a2b5-085cc71508ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:27.229311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd437c5-f8de-44cd-a2b5-085cc71508ee admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:27.229589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd437c5-f8de-44cd-a2b5-085cc71508ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:27.229864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd437c5-f8de-44cd-a2b5-085cc71508ee admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.231188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd437c5-f8de-44cd-a2b5-085cc71508ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:27.233350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd437c5-f8de-44cd-a2b5-085cc71508ee admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:27.256396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1121/2274] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:27 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:27.263500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bc7b0-a3b8-4bb2-8f54-2c74d70b4401 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:27.275248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bc7b0-a3b8-4bb2-8f54-2c74d70b4401 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:27.281016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2c644-1e2a-4671-95b7-6b3e92f5d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:27.282156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c644-1e2a-4671-95b7-6b3e92f5d44b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:27.282156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c644-1e2a-4671-95b7-6b3e92f5d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:27.282378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2c644-1e2a-4671-95b7-6b3e92f5d44b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.283110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2c644-1e2a-4671-95b7-6b3e92f5d44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:27.284775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2c644-1e2a-4671-95b7-6b3e92f5d44b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:27.297604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1154/2275] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:27.302547 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd437c5-f8de-44cd-a2b5-085cc71508ee admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:27.314318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd437c5-f8de-44cd-a2b5-085cc71508ee admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:27.319058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb6ad0-b0ae-4cf6-bdd5-75315f96947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:27.319673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6ad0-b0ae-4cf6-bdd5-75315f96947e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:27.319957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6ad0-b0ae-4cf6-bdd5-75315f96947e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:27.320233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6ad0-b0ae-4cf6-bdd5-75315f96947e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.320881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb6ad0-b0ae-4cf6-bdd5-75315f96947e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:27.322474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb6ad0-b0ae-4cf6-bdd5-75315f96947e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:27.339034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1122/2276] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:20:27.340914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2c644-1e2a-4671-95b7-6b3e92f5d44b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:27.351862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2c644-1e2a-4671-95b7-6b3e92f5d44b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:27.357842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:27.358537 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:27.358815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:27.359125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] PATH_INFO: `/v3/projects/1373cd48c8e3483cbe1edfbfe875cf10/users/e47449e631134964b72a7ee04297b7a1/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.375600 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1373cd48c8e3483cbe1edfbfe875cf10, user_id=e47449e631134964b72a7ee04297b7a1, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:27.378217 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:27.395925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1155/2277] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:27 2022] PUT /identity/v3/projects/1373cd48c8e3483cbe1edfbfe875cf10/users/e47449e631134964b72a7ee04297b7a1/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:27.409115 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3b487-28f1-4ee3-a0cf-2b9384dde761 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:27.409532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3b487-28f1-4ee3-a0cf-2b9384dde761 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:27.409874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3b487-28f1-4ee3-a0cf-2b9384dde761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.456017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6df3b487-28f1-4ee3-a0cf-2b9384dde761 None None] MFA Rules not processed for user `e47449e631134964b72a7ee04297b7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:27.457420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6df3b487-28f1-4ee3-a0cf-2b9384dde761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:27.464011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:27.569108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1123/2278] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:27.582095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:27.584430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:27.663904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f1de0a-5566-4fcd-b0b3-b790aafebc84 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:27.668810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e8fd8-9791-4aed-8d40-7cc374c7539e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a909fc6177e94d2fa6d38dad285e616a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:27.669523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8fd8-9791-4aed-8d40-7cc374c7539e service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:27.669877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8fd8-9791-4aed-8d40-7cc374c7539e service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:27.670227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e8fd8-9791-4aed-8d40-7cc374c7539e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:27.681239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e8fd8-9791-4aed-8d40-7cc374c7539e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:27.683009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e8fd8-9791-4aed-8d40-7cc374c7539e service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:27.689854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:27.702491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1156/2279] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:34.450838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3b487-28f1-4ee3-a0cf-2b9384dde761 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:34.452346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6df3b487-28f1-4ee3-a0cf-2b9384dde761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:34.530214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3b487-28f1-4ee3-a0cf-2b9384dde761 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:34.535602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:34.536241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:34.536522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:34.536795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] PATH_INFO: `/v3/users/d6a0d44723ad48f5842f595ae6d26778` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:34.538189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a0d44723ad48f5842f595ae6d26778)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:34.540135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:34.599761 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a0d44723ad48f5842f595ae6d26778'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:34.619653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a0d44723ad48f5842f595ae6d26778'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:34.619653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a0d44723ad48f5842f595ae6d26778'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:34.619653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a0d44723ad48f5842f595ae6d26778'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:34.630720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a0d44723ad48f5842f595ae6d26778'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:34.651338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1124/2280] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:34 2022] DELETE /identity/v3/users/d6a0d44723ad48f5842f595ae6d26778 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:34.656942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ee9c-b6b9-4e71-9e6a-811a15048870 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:34.657489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ee9c-b6b9-4e71-9e6a-811a15048870 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:34.657715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ee9c-b6b9-4e71-9e6a-811a15048870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:34.678100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-caf8ee9c-b6b9-4e71-9e6a-811a15048870 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:34.679493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-caf8ee9c-b6b9-4e71-9e6a-811a15048870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:34.755583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1157/2281] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:34.766973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:34.770451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:34.823692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:34.860727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df067a0-d6ee-4050-a723-58c6919e680e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:34.864510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb676421-109d-41df-a85d-dc76d23e6389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:34.865153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676421-109d-41df-a85d-dc76d23e6389 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:34.865440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676421-109d-41df-a85d-dc76d23e6389 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:34.865719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676421-109d-41df-a85d-dc76d23e6389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:34.877694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb676421-109d-41df-a85d-dc76d23e6389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:34.879174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb676421-109d-41df-a85d-dc76d23e6389 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:34.889196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1125/2282] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:35.196392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ee9c-b6b9-4e71-9e6a-811a15048870 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:35.198139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-caf8ee9c-b6b9-4e71-9e6a-811a15048870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:35.215447 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8ee9c-b6b9-4e71-9e6a-811a15048870 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:35.221454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:35.222138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:35.222353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:35.222631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] PATH_INFO: `/v3/projects/5ef26ec3ca1d423e9bc634c069abd7cb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:35.224601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef26ec3ca1d423e9bc634c069abd7cb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:35.235949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:35.292473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef26ec3ca1d423e9bc634c069abd7cb', 'request_id': 'req-32bff8f2-4075-4a0d-8b48-54a7062631ee'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.299279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef26ec3ca1d423e9bc634c069abd7cb', 'request_id': 'req-32bff8f2-4075-4a0d-8b48-54a7062631ee'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.313268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef26ec3ca1d423e9bc634c069abd7cb', 'request_id': 'req-32bff8f2-4075-4a0d-8b48-54a7062631ee'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.326154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] The token cache is being invalidate because project 5ef26ec3ca1d423e9bc634c069abd7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:35.326446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.327148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.329097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1158/2283] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:35 2022] DELETE /identity/v3/projects/5ef26ec3ca1d423e9bc634c069abd7cb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:35.332691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb676421-109d-41df-a85d-dc76d23e6389 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:35.342863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb676421-109d-41df-a85d-dc76d23e6389 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:35.409755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:35.410418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:35.411290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:35.411612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] PATH_INFO: `/v3/users/99a6f19b10974bd3a5cdc75ee4eac7cf` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:35.412901 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a6f19b10974bd3a5cdc75ee4eac7cf)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:35.414810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:35.462839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a6f19b10974bd3a5cdc75ee4eac7cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.471203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a6f19b10974bd3a5cdc75ee4eac7cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.471812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a6f19b10974bd3a5cdc75ee4eac7cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.472443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a6f19b10974bd3a5cdc75ee4eac7cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.479678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1f13b667-c441-49ab-aee5-0296fa01bbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a6f19b10974bd3a5cdc75ee4eac7cf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:35.497688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1126/2284] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:35 2022] DELETE /identity/v3/users/99a6f19b10974bd3a5cdc75ee4eac7cf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:35.869778 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:35.871873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:35.888530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bff8f2-4075-4a0d-8b48-54a7062631ee admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:35.961249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:35.961891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:35.962184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:35.962464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] PATH_INFO: `/v3/projects/c4e7c358fa264855bc9fa3cc9c91ac6d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:35.963594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e7c358fa264855bc9fa3cc9c91ac6d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:35.965502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.004143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:36.028351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e7c358fa264855bc9fa3cc9c91ac6d', 'request_id': 'req-71f73b09-d2b1-4d5b-b062-59362b927679'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:36.038187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e7c358fa264855bc9fa3cc9c91ac6d', 'request_id': 'req-71f73b09-d2b1-4d5b-b062-59362b927679'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:36.049235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e7c358fa264855bc9fa3cc9c91ac6d', 'request_id': 'req-71f73b09-d2b1-4d5b-b062-59362b927679'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:36.064641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] The token cache is being invalidate because project c4e7c358fa264855bc9fa3cc9c91ac6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:36.065198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:36.066035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-71f73b09-d2b1-4d5b-b062-59362b927679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:36.067942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1159/2285] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:35 2022] DELETE /identity/v3/projects/c4e7c358fa264855bc9fa3cc9c91ac6d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:36.072890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30440dc8-ae76-48f5-a777-1032e51e96df None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.073248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30440dc8-ae76-48f5-a777-1032e51e96df None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.073535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30440dc8-ae76-48f5-a777-1032e51e96df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.094027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-30440dc8-ae76-48f5-a777-1032e51e96df None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:36.095709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-30440dc8-ae76-48f5-a777-1032e51e96df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:36.150724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:36.166837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1127/2286] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:36.174823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f1f2-ab0a-432b-87e0-f5c95af946e7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.175333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f1f2-ab0a-432b-87e0-f5c95af946e7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.175612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f1f2-ab0a-432b-87e0-f5c95af946e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.197202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-50e5f1f2-ab0a-432b-87e0-f5c95af946e7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:36.198420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-50e5f1f2-ab0a-432b-87e0-f5c95af946e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:36.207157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1160/2287] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:36.211629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30440dc8-ae76-48f5-a777-1032e51e96df None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.221958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30440dc8-ae76-48f5-a777-1032e51e96df None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.226597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.227239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.227524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.227801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.228453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:20:36.228763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.230346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.241882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1128/2288] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:20:36.246267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5f1f2-ab0a-432b-87e0-f5c95af946e7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.258100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5f1f2-ab0a-432b-87e0-f5c95af946e7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.262777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634585-de89-41e3-80f2-4b4e345e8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.263426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634585-de89-41e3-80f2-4b4e345e8224 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.263713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634585-de89-41e3-80f2-4b4e345e8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.263974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634585-de89-41e3-80f2-4b4e345e8224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.264615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f634585-de89-41e3-80f2-4b4e345e8224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.267122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f634585-de89-41e3-80f2-4b4e345e8224 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.296707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1161/2289] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:36 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:36.300978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.311270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052816f2-af13-41cd-98a0-5bb8f793a83b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.368744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69fced-298f-43dd-a910-099272be6100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.369336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69fced-298f-43dd-a910-099272be6100 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.369796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69fced-298f-43dd-a910-099272be6100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.370155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69fced-298f-43dd-a910-099272be6100 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.370912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69fced-298f-43dd-a910-099272be6100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.373056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69fced-298f-43dd-a910-099272be6100 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.399889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1129/2290] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:36 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:36.404034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634585-de89-41e3-80f2-4b4e345e8224 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.414428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634585-de89-41e3-80f2-4b4e345e8224 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.419120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83583c79-0ba3-4798-a39a-f00bbb14626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.419727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583c79-0ba3-4798-a39a-f00bbb14626d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.420008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583c79-0ba3-4798-a39a-f00bbb14626d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.420281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83583c79-0ba3-4798-a39a-f00bbb14626d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.421001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83583c79-0ba3-4798-a39a-f00bbb14626d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.423420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83583c79-0ba3-4798-a39a-f00bbb14626d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.436378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1162/2291] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:36.438403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69fced-298f-43dd-a910-099272be6100 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.449157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69fced-298f-43dd-a910-099272be6100 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.454631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d21a7-b01a-4814-8f9c-0922f3572bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.455287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d21a7-b01a-4814-8f9c-0922f3572bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.455575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d21a7-b01a-4814-8f9c-0922f3572bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.455852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d21a7-b01a-4814-8f9c-0922f3572bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.456507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d21a7-b01a-4814-8f9c-0922f3572bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.458115 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d21a7-b01a-4814-8f9c-0922f3572bd6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.469349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1130/2292] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:36.473804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83583c79-0ba3-4798-a39a-f00bbb14626d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.483835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83583c79-0ba3-4798-a39a-f00bbb14626d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.489116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157048f8-8962-42e9-a576-ca586385e2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.489765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157048f8-8962-42e9-a576-ca586385e2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.490049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157048f8-8962-42e9-a576-ca586385e2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.490324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157048f8-8962-42e9-a576-ca586385e2fd admin admin] PATH_INFO: `/v3/projects/e5cc65b1bae0426aab123d17c61852c5/users/1e7ac92982924da485c255723a6b9b7e/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.504809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157048f8-8962-42e9-a576-ca586385e2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cc65b1bae0426aab123d17c61852c5, user_id=1e7ac92982924da485c255723a6b9b7e, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.507484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157048f8-8962-42e9-a576-ca586385e2fd admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.521664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1163/2293] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:36 2022] PUT /identity/v3/projects/e5cc65b1bae0426aab123d17c61852c5/users/1e7ac92982924da485c255723a6b9b7e/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:36.533917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77afc12-df3b-434b-8b69-53199a6d2d60 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.534239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77afc12-df3b-434b-8b69-53199a6d2d60 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.534468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77afc12-df3b-434b-8b69-53199a6d2d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.564377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f77afc12-df3b-434b-8b69-53199a6d2d60 None None] MFA Rules not processed for user `1e7ac92982924da485c255723a6b9b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:36.565592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f77afc12-df3b-434b-8b69-53199a6d2d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:36.646126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1131/2294] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:36.650915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157048f8-8962-42e9-a576-ca586385e2fd admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.723709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157048f8-8962-42e9-a576-ca586385e2fd admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.729627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953078-01af-4a3f-baa3-ef81d430f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.730387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953078-01af-4a3f-baa3-ef81d430f38c admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.730608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953078-01af-4a3f-baa3-ef81d430f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.730810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42953078-01af-4a3f-baa3-ef81d430f38c admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.731495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42953078-01af-4a3f-baa3-ef81d430f38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.733435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42953078-01af-4a3f-baa3-ef81d430f38c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.766864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1164/2295] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:36 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:36.768012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77afc12-df3b-434b-8b69-53199a6d2d60 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.778630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77afc12-df3b-434b-8b69-53199a6d2d60 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.830710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:36.852271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316430c-0807-47e3-a27a-0142b602f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.853168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316430c-0807-47e3-a27a-0142b602f3d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.854608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316430c-0807-47e3-a27a-0142b602f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.855041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316430c-0807-47e3-a27a-0142b602f3d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.856577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316430c-0807-47e3-a27a-0142b602f3d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.859218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316430c-0807-47e3-a27a-0142b602f3d1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.883434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1132/2296] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:36 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:20:36.887523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953078-01af-4a3f-baa3-ef81d430f38c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.902014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42953078-01af-4a3f-baa3-ef81d430f38c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.911025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e037ac-a217-451a-8a90-8b34a2f6634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.911735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e037ac-a217-451a-8a90-8b34a2f6634b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.912110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e037ac-a217-451a-8a90-8b34a2f6634b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.912484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e037ac-a217-451a-8a90-8b34a2f6634b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.916379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e037ac-a217-451a-8a90-8b34a2f6634b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.916379 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e037ac-a217-451a-8a90-8b34a2f6634b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.930963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1165/2297] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:36.932191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316430c-0807-47e3-a27a-0142b602f3d1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:36.942628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316430c-0807-47e3-a27a-0142b602f3d1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:36.949098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d907fd-3874-4808-b610-b4ef853ee39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:36.949770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d907fd-3874-4808-b610-b4ef853ee39c admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:36.950043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d907fd-3874-4808-b610-b4ef853ee39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:36.950319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d907fd-3874-4808-b610-b4ef853ee39c admin admin] PATH_INFO: `/v3/projects/ec9d24fc341a41a5b5fbb47b88e7d0f2/users/065b0d1644ab4c1bbe84fd84bda7c987/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:36.974235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d907fd-3874-4808-b610-b4ef853ee39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9d24fc341a41a5b5fbb47b88e7d0f2, user_id=065b0d1644ab4c1bbe84fd84bda7c987, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:36.976980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d907fd-3874-4808-b610-b4ef853ee39c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:36.999413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1133/2298] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:36 2022] PUT /identity/v3/projects/ec9d24fc341a41a5b5fbb47b88e7d0f2/users/065b0d1644ab4c1bbe84fd84bda7c987/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:37.003518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e037ac-a217-451a-8a90-8b34a2f6634b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:37.014071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e037ac-a217-451a-8a90-8b34a2f6634b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:37.039183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:37.082796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad740dac-dc1b-4c6b-a019-56bc9977eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:37.083600 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740dac-dc1b-4c6b-a019-56bc9977eac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:37.083877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740dac-dc1b-4c6b-a019-56bc9977eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:37.084146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740dac-dc1b-4c6b-a019-56bc9977eac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:37.084796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad740dac-dc1b-4c6b-a019-56bc9977eac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:37.086439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad740dac-dc1b-4c6b-a019-56bc9977eac0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:37.103416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1166/2299] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:37.105021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d907fd-3874-4808-b610-b4ef853ee39c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:37.130367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d907fd-3874-4808-b610-b4ef853ee39c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:37.136412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:37.137312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:37.137687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:37.138128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] PATH_INFO: `/v3/projects/ec9d24fc341a41a5b5fbb47b88e7d0f2/users/065b0d1644ab4c1bbe84fd84bda7c987/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:37.141535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9d24fc341a41a5b5fbb47b88e7d0f2, user_id=065b0d1644ab4c1bbe84fd84bda7c987, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:37.145726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:37.159517 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1134/2300] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:37 2022] PUT /identity/v3/projects/ec9d24fc341a41a5b5fbb47b88e7d0f2/users/065b0d1644ab4c1bbe84fd84bda7c987/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:37.169707 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ba34-5ac6-4fd5-a79d-57c6eb371df5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:37.170077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ba34-5ac6-4fd5-a79d-57c6eb371df5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:37.170297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ba34-5ac6-4fd5-a79d-57c6eb371df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:37.202851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3948ba34-5ac6-4fd5-a79d-57c6eb371df5 None None] MFA Rules not processed for user `065b0d1644ab4c1bbe84fd84bda7c987`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:37.204709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3948ba34-5ac6-4fd5-a79d-57c6eb371df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:37.298054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1167/2301] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:37.308815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:37.310558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:37.381067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a611a-ab31-4380-b7a0-51c40c8a4f95 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:37.384900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421573c-18f6-4a40-9ef4-5b9ae8f8c097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:37.385512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421573c-18f6-4a40-9ef4-5b9ae8f8c097 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:37.385793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421573c-18f6-4a40-9ef4-5b9ae8f8c097 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:37.386072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421573c-18f6-4a40-9ef4-5b9ae8f8c097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:37.395398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421573c-18f6-4a40-9ef4-5b9ae8f8c097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:37.396815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421573c-18f6-4a40-9ef4-5b9ae8f8c097 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:37.406312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1135/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:37.466157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948ba34-5ac6-4fd5-a79d-57c6eb371df5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:37.467587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3948ba34-5ac6-4fd5-a79d-57c6eb371df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:37.479758 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948ba34-5ac6-4fd5-a79d-57c6eb371df5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:37.483394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8a618-a8f4-4e36-aebc-3c718bab0038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:37.483997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8a618-a8f4-4e36-aebc-3c718bab0038 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:37.484783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8a618-a8f4-4e36-aebc-3c718bab0038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:37.485283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8a618-a8f4-4e36-aebc-3c718bab0038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:37.543560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8a618-a8f4-4e36-aebc-3c718bab0038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:37.545003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8a618-a8f4-4e36-aebc-3c718bab0038 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:37.554798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1168/2303] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:40.911385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421573c-18f6-4a40-9ef4-5b9ae8f8c097 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:40.989268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421573c-18f6-4a40-9ef4-5b9ae8f8c097 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:40.993679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:40.994313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:40.994590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:40.994865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] PATH_INFO: `/v3/users/1e7ac92982924da485c255723a6b9b7e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:40.996007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7ac92982924da485c255723a6b9b7e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:40.997900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:41.040765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:41.046480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7ac92982924da485c255723a6b9b7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.061176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7ac92982924da485c255723a6b9b7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.061878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7ac92982924da485c255723a6b9b7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.062486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7ac92982924da485c255723a6b9b7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.070722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7ac92982924da485c255723a6b9b7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.093042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1136/2304] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:40 2022] DELETE /identity/v3/users/1e7ac92982924da485c255723a6b9b7e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:41.098087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976539-7dc4-4c39-94a6-63874eaf1516 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:41.098564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976539-7dc4-4c39-94a6-63874eaf1516 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:41.098673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69976539-7dc4-4c39-94a6-63874eaf1516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:41.118384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-69976539-7dc4-4c39-94a6-63874eaf1516 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:41.119747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-69976539-7dc4-4c39-94a6-63874eaf1516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:41.172439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:41.199197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1169/2305] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:41.208461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:41.209906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:41.278290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bf19b-f340-4f8d-8247-e82a6829225c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:41.283320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe61d-030b-488d-8966-1478bce199ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:41.283969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe61d-030b-488d-8966-1478bce199ed service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:41.284250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe61d-030b-488d-8966-1478bce199ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:41.284523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe61d-030b-488d-8966-1478bce199ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:41.304050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe61d-030b-488d-8966-1478bce199ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:41.306001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe61d-030b-488d-8966-1478bce199ed service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:41.319380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1137/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:41.672095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69976539-7dc4-4c39-94a6-63874eaf1516 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:41.674723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-69976539-7dc4-4c39-94a6-63874eaf1516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:41.688388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69976539-7dc4-4c39-94a6-63874eaf1516 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:41.707096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:41.708021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:41.708317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:41.708581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] PATH_INFO: `/v3/projects/e5cc65b1bae0426aab123d17c61852c5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:41.710533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5cc65b1bae0426aab123d17c61852c5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:41.712602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:41.766387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5cc65b1bae0426aab123d17c61852c5', 'request_id': 'req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.773236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5cc65b1bae0426aab123d17c61852c5', 'request_id': 'req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.782249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5cc65b1bae0426aab123d17c61852c5', 'request_id': 'req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.793639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] The token cache is being invalidate because project e5cc65b1bae0426aab123d17c61852c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:41.794018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.794659 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ab2eeade-60bb-4c1e-bfc2-3e865622ce0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.796285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1170/2307] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:41 2022] DELETE /identity/v3/projects/e5cc65b1bae0426aab123d17c61852c5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:41.801069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe61d-030b-488d-8966-1478bce199ed service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:41.813402 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe61d-030b-488d-8966-1478bce199ed service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:41.880891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:41.882155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:41.882438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:41.882711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] PATH_INFO: `/v3/users/065b0d1644ab4c1bbe84fd84bda7c987` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:41.883885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065b0d1644ab4c1bbe84fd84bda7c987)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:41.885813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:41.931781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065b0d1644ab4c1bbe84fd84bda7c987'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.939899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065b0d1644ab4c1bbe84fd84bda7c987'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.940744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065b0d1644ab4c1bbe84fd84bda7c987'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.941413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065b0d1644ab4c1bbe84fd84bda7c987'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.971028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065b0d1644ab4c1bbe84fd84bda7c987'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:41.972946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:41.991872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73ce9-698d-4b87-afb4-21c8a4bf4cae None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:41.992156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73ce9-698d-4b87-afb4-21c8a4bf4cae None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:41.992525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e73ce9-698d-4b87-afb4-21c8a4bf4cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:42.012759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1138/2308] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:41 2022] DELETE /identity/v3/users/065b0d1644ab4c1bbe84fd84bda7c987 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:42.026158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-25e73ce9-698d-4b87-afb4-21c8a4bf4cae None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:42.032535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-25e73ce9-698d-4b87-afb4-21c8a4bf4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:42.110821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1171/2309] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:20:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:42.124789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:42.126415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:42.263187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e622e-19a2-43d8-80e7-8cd3a62994b2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:42.271046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6da1-f7f1-42e6-bfa7-c5a830afdb3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:42.271816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6da1-f7f1-42e6-bfa7-c5a830afdb3f service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:42.271964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6da1-f7f1-42e6-bfa7-c5a830afdb3f service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:42.272244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6da1-f7f1-42e6-bfa7-c5a830afdb3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:42.320846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6da1-f7f1-42e6-bfa7-c5a830afdb3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:42.323026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6da1-f7f1-42e6-bfa7-c5a830afdb3f service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:42.335103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1139/2310] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:20:42.337556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e73ce9-698d-4b87-afb4-21c8a4bf4cae None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:42.339568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-25e73ce9-698d-4b87-afb4-21c8a4bf4cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:42.494706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e73ce9-698d-4b87-afb4-21c8a4bf4cae None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:42.507208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:42.507868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:42.508148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:42.508427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] PATH_INFO: `/v3/projects/ec9d24fc341a41a5b5fbb47b88e7d0f2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:42.511985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9d24fc341a41a5b5fbb47b88e7d0f2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:42.514166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:42.565068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:42.620658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9d24fc341a41a5b5fbb47b88e7d0f2', 'request_id': 'req-267e21fb-5bae-4bbf-b191-e539b99e1be3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:42.632117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9d24fc341a41a5b5fbb47b88e7d0f2', 'request_id': 'req-267e21fb-5bae-4bbf-b191-e539b99e1be3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:42.647519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9d24fc341a41a5b5fbb47b88e7d0f2', 'request_id': 'req-267e21fb-5bae-4bbf-b191-e539b99e1be3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:42.662953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] The token cache is being invalidate because project ec9d24fc341a41a5b5fbb47b88e7d0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:42.663380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:42.664136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-267e21fb-5bae-4bbf-b191-e539b99e1be3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:42.665972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1172/2311] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:42 2022] DELETE /identity/v3/projects/ec9d24fc341a41a5b5fbb47b88e7d0f2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:42.672964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664b581-4dc8-46dc-b54f-f156ee4b46a9 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:42.673509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664b581-4dc8-46dc-b54f-f156ee4b46a9 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:42.673959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664b581-4dc8-46dc-b54f-f156ee4b46a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:42.712968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5664b581-4dc8-46dc-b54f-f156ee4b46a9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:42.716863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5664b581-4dc8-46dc-b54f-f156ee4b46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:42.855510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9cd8-5913-4e2f-9cef-7d5e00d0ba36 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:42.855727 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9cd8-5913-4e2f-9cef-7d5e00d0ba36 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:42.856089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9cd8-5913-4e2f-9cef-7d5e00d0ba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:42.864064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1140/2312] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:42.872841 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5fa6b-cd5a-4027-824f-3aa07e1e6c4b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:42.873179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5fa6b-cd5a-4027-824f-3aa07e1e6c4b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:42.873474 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5fa6b-cd5a-4027-824f-3aa07e1e6c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:42.893995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ecdc9cd8-5913-4e2f-9cef-7d5e00d0ba36 None None] MFA Rules not processed for user `0522e5c104c54f75b249ec924b0b08d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:42.895354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ecdc9cd8-5913-4e2f-9cef-7d5e00d0ba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:42.903086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-77e5fa6b-cd5a-4027-824f-3aa07e1e6c4b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:42.904526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-77e5fa6b-cd5a-4027-824f-3aa07e1e6c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:42.916930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1141/2313] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:42.918774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5fa6b-cd5a-4027-824f-3aa07e1e6c4b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:42.932834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5fa6b-cd5a-4027-824f-3aa07e1e6c4b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:42.947969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:42.948681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:42.949344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:42.949625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:42.950363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:20:42.950690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:42.957604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:42.984722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1142/2314] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:20:42.995238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.007614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1173/2315] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:43.018340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d70be-37cf-46ca-9aeb-dd799acc7902 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.035882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168284f-c74a-4c8e-b7cd-e6a7b370759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.037060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168284f-c74a-4c8e-b7cd-e6a7b370759e admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.037684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168284f-c74a-4c8e-b7cd-e6a7b370759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.037891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168284f-c74a-4c8e-b7cd-e6a7b370759e admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.038633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168284f-c74a-4c8e-b7cd-e6a7b370759e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.040857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168284f-c74a-4c8e-b7cd-e6a7b370759e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.085930 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1143/2316] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:42 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:43.090027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9cd8-5913-4e2f-9cef-7d5e00d0ba36 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.102173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9cd8-5913-4e2f-9cef-7d5e00d0ba36 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.161909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa5f01-fa01-40cf-804c-d41f613f4dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.162620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa5f01-fa01-40cf-804c-d41f613f4dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.162790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa5f01-fa01-40cf-804c-d41f613f4dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.163228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa5f01-fa01-40cf-804c-d41f613f4dfc admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.163874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa5f01-fa01-40cf-804c-d41f613f4dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.165783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa5f01-fa01-40cf-804c-d41f613f4dfc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.201943 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1174/2317] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:43 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:20:43.203101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168284f-c74a-4c8e-b7cd-e6a7b370759e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.213937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168284f-c74a-4c8e-b7cd-e6a7b370759e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.219453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d65d3b-2920-442c-9456-018f66f94206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.221055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65d3b-2920-442c-9456-018f66f94206 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.221220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65d3b-2920-442c-9456-018f66f94206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.221572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65d3b-2920-442c-9456-018f66f94206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.222545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d65d3b-2920-442c-9456-018f66f94206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.224276 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d65d3b-2920-442c-9456-018f66f94206 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.236630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1144/2318] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:20:43.240795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa5f01-fa01-40cf-804c-d41f613f4dfc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.258086 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa5f01-fa01-40cf-804c-d41f613f4dfc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.263515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22065b94-1d7e-4043-8c7b-c97f1dc2b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.264259 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065b94-1d7e-4043-8c7b-c97f1dc2b400 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.264651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065b94-1d7e-4043-8c7b-c97f1dc2b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.265029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065b94-1d7e-4043-8c7b-c97f1dc2b400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.265811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065b94-1d7e-4043-8c7b-c97f1dc2b400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.268069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22065b94-1d7e-4043-8c7b-c97f1dc2b400 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.280332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1175/2319] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:43.284712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d65d3b-2920-442c-9456-018f66f94206 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.295754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d65d3b-2920-442c-9456-018f66f94206 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.311964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad916f7-c110-48fa-b503-f4c957fc5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.312698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad916f7-c110-48fa-b503-f4c957fc5e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.312984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad916f7-c110-48fa-b503-f4c957fc5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.313257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad916f7-c110-48fa-b503-f4c957fc5e31 admin admin] PATH_INFO: `/v3/projects/f812d23ed9304ebc9593cb8cc0d645c9/users/66d9e6a357b3434899bbba5b93838b9d/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.333020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad916f7-c110-48fa-b503-f4c957fc5e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f812d23ed9304ebc9593cb8cc0d645c9, user_id=66d9e6a357b3434899bbba5b93838b9d, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.337166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad916f7-c110-48fa-b503-f4c957fc5e31 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.340797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:43.368931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1145/2320] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:43 2022] PUT /identity/v3/projects/f812d23ed9304ebc9593cb8cc0d645c9/users/66d9e6a357b3434899bbba5b93838b9d/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:43.382449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3aeaf-3815-4b9b-bab4-d71f7041c539 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.382761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3aeaf-3815-4b9b-bab4-d71f7041c539 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.383098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3aeaf-3815-4b9b-bab4-d71f7041c539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.414011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-64b3aeaf-3815-4b9b-bab4-d71f7041c539 None None] MFA Rules not processed for user `66d9e6a357b3434899bbba5b93838b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:43.415271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-64b3aeaf-3815-4b9b-bab4-d71f7041c539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:43.451468 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:43.542158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1176/2321] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:43.546707 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad916f7-c110-48fa-b503-f4c957fc5e31 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.643796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad916f7-c110-48fa-b503-f4c957fc5e31 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.648618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a97f2f-ed67-43b7-8fd4-7aa192d124d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.649237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a97f2f-ed67-43b7-8fd4-7aa192d124d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.649554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a97f2f-ed67-43b7-8fd4-7aa192d124d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.649831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a97f2f-ed67-43b7-8fd4-7aa192d124d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.650471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a97f2f-ed67-43b7-8fd4-7aa192d124d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.652410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a97f2f-ed67-43b7-8fd4-7aa192d124d5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.686413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1146/2322] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:43 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:43.690567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3aeaf-3815-4b9b-bab4-d71f7041c539 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.701719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3aeaf-3815-4b9b-bab4-d71f7041c539 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.761850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89cceb-6107-4d2a-9963-d0549c4c0092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.762477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cceb-6107-4d2a-9963-d0549c4c0092 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.762753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cceb-6107-4d2a-9963-d0549c4c0092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.763052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cceb-6107-4d2a-9963-d0549c4c0092 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.763706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89cceb-6107-4d2a-9963-d0549c4c0092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.765703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89cceb-6107-4d2a-9963-d0549c4c0092 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.800629 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1177/2323] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:43 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:43.804377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a97f2f-ed67-43b7-8fd4-7aa192d124d5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.815352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a97f2f-ed67-43b7-8fd4-7aa192d124d5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.820055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a0a6b-2812-4ef5-81c5-00c6e57840fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.820660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a0a6b-2812-4ef5-81c5-00c6e57840fb admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.820941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a0a6b-2812-4ef5-81c5-00c6e57840fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.821217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a0a6b-2812-4ef5-81c5-00c6e57840fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.821857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a0a6b-2812-4ef5-81c5-00c6e57840fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.823516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a0a6b-2812-4ef5-81c5-00c6e57840fb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.834917 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1147/2324] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:20:43.839143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89cceb-6107-4d2a-9963-d0549c4c0092 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.851493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89cceb-6107-4d2a-9963-d0549c4c0092 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.856158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8970a24-503b-409b-b9ed-abacd8da5531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.856888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8970a24-503b-409b-b9ed-abacd8da5531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.857165 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8970a24-503b-409b-b9ed-abacd8da5531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.857442 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8970a24-503b-409b-b9ed-abacd8da5531 admin admin] PATH_INFO: `/v3/projects/acc005fe29e4432d8135821ca68cac70/users/7f393aec67404fc4af3d974a5492f8a2/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.876573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8970a24-503b-409b-b9ed-abacd8da5531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc005fe29e4432d8135821ca68cac70, user_id=7f393aec67404fc4af3d974a5492f8a2, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.880012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8970a24-503b-409b-b9ed-abacd8da5531 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:43.895272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1178/2325] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:43 2022] PUT /identity/v3/projects/acc005fe29e4432d8135821ca68cac70/users/7f393aec67404fc4af3d974a5492f8a2/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:43.899304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a0a6b-2812-4ef5-81c5-00c6e57840fb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:43.912824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a0a6b-2812-4ef5-81c5-00c6e57840fb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:43.989388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4eff1-090f-4be9-94ed-369a98632db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:43.990691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eff1-090f-4be9-94ed-369a98632db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:43.990691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eff1-090f-4be9-94ed-369a98632db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:43.995238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4eff1-090f-4be9-94ed-369a98632db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:43.996855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4eff1-090f-4be9-94ed-369a98632db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:43.998571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4eff1-090f-4be9-94ed-369a98632db4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:44.013419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1148/2326] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:44.018744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8970a24-503b-409b-b9ed-abacd8da5531 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:44.035320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8970a24-503b-409b-b9ed-abacd8da5531 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:44.040254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:44.041054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:44.041413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:44.041763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] PATH_INFO: `/v3/projects/acc005fe29e4432d8135821ca68cac70/users/7f393aec67404fc4af3d974a5492f8a2/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:44.044553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc005fe29e4432d8135821ca68cac70, user_id=7f393aec67404fc4af3d974a5492f8a2, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:44.047643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:44.059544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1179/2327] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:44 2022] PUT /identity/v3/projects/acc005fe29e4432d8135821ca68cac70/users/7f393aec67404fc4af3d974a5492f8a2/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:20:44.069770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9423c9-8bb0-495e-9ee5-b3c1c333763f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:44.070058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9423c9-8bb0-495e-9ee5-b3c1c333763f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:44.070336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9423c9-8bb0-495e-9ee5-b3c1c333763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:44.103982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9b9423c9-8bb0-495e-9ee5-b3c1c333763f None None] MFA Rules not processed for user `7f393aec67404fc4af3d974a5492f8a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:44.105206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9b9423c9-8bb0-495e-9ee5-b3c1c333763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:44.178542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:44.200399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1149/2328] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:44.212041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:44.213766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:44.299032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf4191-ccc4-4443-b9a1-e46cd69e448a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:44.302900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122818fc-0ff1-4285-9284-9d6b072bc744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:44.303639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122818fc-0ff1-4285-9284-9d6b072bc744 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:44.303987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122818fc-0ff1-4285-9284-9d6b072bc744 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:44.304336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122818fc-0ff1-4285-9284-9d6b072bc744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:44.315846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122818fc-0ff1-4285-9284-9d6b072bc744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:44.317307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122818fc-0ff1-4285-9284-9d6b072bc744 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:44.327917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1180/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:20:44.440193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9423c9-8bb0-495e-9ee5-b3c1c333763f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:44.450444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9423c9-8bb0-495e-9ee5-b3c1c333763f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:44.454031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:44.455324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:44.455611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:44.455891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:44.519747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:44.521309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:44.530920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1150/2330] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:45.655532 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39d23b-d76e-4908-b9f5-f90c2ed716a1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:45.656489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39d23b-d76e-4908-b9f5-f90c2ed716a1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:45.656840 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39d23b-d76e-4908-b9f5-f90c2ed716a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:45.681456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4f39d23b-d76e-4908-b9f5-f90c2ed716a1 None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:45.683469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4f39d23b-d76e-4908-b9f5-f90c2ed716a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:45.690189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:45.763371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1181/2331] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:20:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:45.778377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:45.779817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:45.873939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c1d9b-934e-4f9f-bc7b-dd48160ae1d2 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:45.880265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107d42-950d-4d59-ad96-6d979a47ea86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:45.881063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107d42-950d-4d59-ad96-6d979a47ea86 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:45.881356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107d42-950d-4d59-ad96-6d979a47ea86 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:45.881867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4107d42-950d-4d59-ad96-6d979a47ea86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:45.891362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4107d42-950d-4d59-ad96-6d979a47ea86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:45.893449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4107d42-950d-4d59-ad96-6d979a47ea86 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:45.903566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1151/2332] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:20:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:20:46.757922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcb85f-ab86-4b3f-94d0-a9e0c0a378d3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:46.758422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcb85f-ab86-4b3f-94d0-a9e0c0a378d3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:46.758621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcb85f-ab86-4b3f-94d0-a9e0c0a378d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:46.780435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-35dcb85f-ab86-4b3f-94d0-a9e0c0a378d3 None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:46.781509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-35dcb85f-ab86-4b3f-94d0-a9e0c0a378d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:46.790353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1182/2333] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 19:20:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:46.812891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107d42-950d-4d59-ad96-6d979a47ea86 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:46.823926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4107d42-950d-4d59-ad96-6d979a47ea86 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:46.830377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5340e-8c8c-4e4c-af08-2780c65fa26e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:46.831314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5340e-8c8c-4e4c-af08-2780c65fa26e service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:46.831674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5340e-8c8c-4e4c-af08-2780c65fa26e service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:46.839335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5340e-8c8c-4e4c-af08-2780c65fa26e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:46.851292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5340e-8c8c-4e4c-af08-2780c65fa26e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:46.853053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5340e-8c8c-4e4c-af08-2780c65fa26e service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:46.861950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1152/2334] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:20:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:20:47.227620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c07da-3d9a-4da1-9506-fd79ce8ad234 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:47.231434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c07da-3d9a-4da1-9506-fd79ce8ad234 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:47.237367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c07da-3d9a-4da1-9506-fd79ce8ad234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:47.285698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-958c07da-3d9a-4da1-9506-fd79ce8ad234 None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:47.286874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-958c07da-3d9a-4da1-9506-fd79ce8ad234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:47.307108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1183/2335] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:47.333389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5340e-8c8c-4e4c-af08-2780c65fa26e service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:47.353505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5340e-8c8c-4e4c-af08-2780c65fa26e service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:47.363811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f5eb9-c7ba-43e7-8d00-07e94341b10f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:47.364719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f5eb9-c7ba-43e7-8d00-07e94341b10f service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:47.365008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f5eb9-c7ba-43e7-8d00-07e94341b10f service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:47.365771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f5eb9-c7ba-43e7-8d00-07e94341b10f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:47.377472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f5eb9-c7ba-43e7-8d00-07e94341b10f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:47.379918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f5eb9-c7ba-43e7-8d00-07e94341b10f service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:47.392791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1153/2336] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:20:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:20:47.912291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6867-65ee-4af7-8533-ce6bf5816f9c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:47.912807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6867-65ee-4af7-8533-ce6bf5816f9c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:47.912912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d6867-65ee-4af7-8533-ce6bf5816f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:47.933626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1d6d6867-65ee-4af7-8533-ce6bf5816f9c None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:47.935384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1d6d6867-65ee-4af7-8533-ce6bf5816f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:47.945333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1184/2337] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:47.968044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f5eb9-c7ba-43e7-8d00-07e94341b10f service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:47.980666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f5eb9-c7ba-43e7-8d00-07e94341b10f service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:47.987449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f1e2d-c6b3-4047-b201-4f2a674077f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:47.987449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1e2d-c6b3-4047-b201-4f2a674077f1 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:47.987824 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1e2d-c6b3-4047-b201-4f2a674077f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:47.988033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f1e2d-c6b3-4047-b201-4f2a674077f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:48.001388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f1e2d-c6b3-4047-b201-4f2a674077f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:48.003146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f1e2d-c6b3-4047-b201-4f2a674077f1 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:48.012929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1154/2338] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:20:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:20:48.505605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d6867-65ee-4af7-8533-ce6bf5816f9c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:48.599607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d6867-65ee-4af7-8533-ce6bf5816f9c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:48.604476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:48.605229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:48.605522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:48.607361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] PATH_INFO: `/v3/users/66d9e6a357b3434899bbba5b93838b9d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:48.611889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d9e6a357b3434899bbba5b93838b9d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:48.613843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:48.702869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d9e6a357b3434899bbba5b93838b9d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:48.730648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d9e6a357b3434899bbba5b93838b9d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:48.731333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d9e6a357b3434899bbba5b93838b9d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:48.731975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d9e6a357b3434899bbba5b93838b9d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:48.750059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d9e6a357b3434899bbba5b93838b9d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:48.783155 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1185/2339] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:48 2022] DELETE /identity/v3/users/66d9e6a357b3434899bbba5b93838b9d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:48.784338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae0c3a-b54c-4836-affe-03ff84be9b36 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:48.784629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae0c3a-b54c-4836-affe-03ff84be9b36 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:48.784909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae0c3a-b54c-4836-affe-03ff84be9b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:48.822433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7fae0c3a-b54c-4836-affe-03ff84be9b36 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:48.824046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7fae0c3a-b54c-4836-affe-03ff84be9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:48.888907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:48.938012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1155/2340] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:48.948597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:48.950057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:48.970953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:49.028835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4007eda-bb23-4b35-ad36-ea86e4eaa798 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:49.033714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43c5a9-f7eb-4038-b025-4e73d697941d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:49.034861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c5a9-f7eb-4038-b025-4e73d697941d service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:49.035323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c5a9-f7eb-4038-b025-4e73d697941d service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:49.035762 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c5a9-f7eb-4038-b025-4e73d697941d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:49.046944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43c5a9-f7eb-4038-b025-4e73d697941d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:49.048919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43c5a9-f7eb-4038-b025-4e73d697941d service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:49.062060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1186/2341] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:49.442135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae0c3a-b54c-4836-affe-03ff84be9b36 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:49.443885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7fae0c3a-b54c-4836-affe-03ff84be9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:49.466429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae0c3a-b54c-4836-affe-03ff84be9b36 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:49.473884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:49.476018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:49.477245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:49.478236 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] PATH_INFO: `/v3/projects/f812d23ed9304ebc9593cb8cc0d645c9` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:49.480396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f812d23ed9304ebc9593cb8cc0d645c9)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:49.483338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:49.538804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f812d23ed9304ebc9593cb8cc0d645c9', 'request_id': 'req-457c90a8-5c13-4b13-8558-e755c6fc76d0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.545532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f812d23ed9304ebc9593cb8cc0d645c9', 'request_id': 'req-457c90a8-5c13-4b13-8558-e755c6fc76d0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.554764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f812d23ed9304ebc9593cb8cc0d645c9', 'request_id': 'req-457c90a8-5c13-4b13-8558-e755c6fc76d0'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.568171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] The token cache is being invalidate because project f812d23ed9304ebc9593cb8cc0d645c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:49.568537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.569131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.570886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1156/2342] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:49 2022] DELETE /identity/v3/projects/f812d23ed9304ebc9593cb8cc0d645c9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:49.574665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43c5a9-f7eb-4038-b025-4e73d697941d service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:49.586240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43c5a9-f7eb-4038-b025-4e73d697941d service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:49.652987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:49.654340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:49.654889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:49.655506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] PATH_INFO: `/v3/users/7f393aec67404fc4af3d974a5492f8a2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:49.657892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f393aec67404fc4af3d974a5492f8a2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:49.660091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:49.709423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f393aec67404fc4af3d974a5492f8a2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.721982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f393aec67404fc4af3d974a5492f8a2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.722616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f393aec67404fc4af3d974a5492f8a2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.723382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f393aec67404fc4af3d974a5492f8a2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.738571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-452dc5f6-2030-40d3-bbb5-c416756bfc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f393aec67404fc4af3d974a5492f8a2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:49.757107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1187/2343] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:49 2022] DELETE /identity/v3/users/7f393aec67404fc4af3d974a5492f8a2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:50.098740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.100783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:50.117022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c90a8-5c13-4b13-8558-e755c6fc76d0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.189269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.189877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.190161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.190439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] PATH_INFO: `/v3/projects/acc005fe29e4432d8135821ca68cac70` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.191622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc005fe29e4432d8135821ca68cac70)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.193518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.252777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc005fe29e4432d8135821ca68cac70', 'request_id': 'req-a79f9d8b-0c1b-49b2-817f-633d257fed2d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.259052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc005fe29e4432d8135821ca68cac70', 'request_id': 'req-a79f9d8b-0c1b-49b2-817f-633d257fed2d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.267466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc005fe29e4432d8135821ca68cac70', 'request_id': 'req-a79f9d8b-0c1b-49b2-817f-633d257fed2d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.269703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:50.281136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] The token cache is being invalidate because project acc005fe29e4432d8135821ca68cac70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:50.281714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.282645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.284261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1157/2344] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:50 2022] DELETE /identity/v3/projects/acc005fe29e4432d8135821ca68cac70 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:50.289156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429915-0dd2-4b99-896b-108f60fc83b2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.289620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429915-0dd2-4b99-896b-108f60fc83b2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.289728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429915-0dd2-4b99-896b-108f60fc83b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.319250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e3429915-0dd2-4b99-896b-108f60fc83b2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:50.320527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e3429915-0dd2-4b99-896b-108f60fc83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:50.356136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.357793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:50.384113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:50.425810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1188/2345] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:50.436810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184153bf-df58-4ae8-a6bf-ded1f716fa0a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.437391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184153bf-df58-4ae8-a6bf-ded1f716fa0a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.437902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184153bf-df58-4ae8-a6bf-ded1f716fa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.463959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f9d8b-0c1b-49b2-817f-633d257fed2d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.468712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.469358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.469602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-184153bf-df58-4ae8-a6bf-ded1f716fa0a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:50.470021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.471244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] PATH_INFO: `/v3/users/e520f1d390c94369b065721b32ba3131` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.471620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-184153bf-df58-4ae8-a6bf-ded1f716fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:50.473693 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e520f1d390c94369b065721b32ba3131)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.476721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.484841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1189/2346] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:50.489190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184153bf-df58-4ae8-a6bf-ded1f716fa0a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.499823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184153bf-df58-4ae8-a6bf-ded1f716fa0a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.506903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.507775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.508215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.508640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.509554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:20:50.510014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.511819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.527094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1190/2347] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:20:50.531759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.542089 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b42997-87f1-4c61-9186-cca168d8e7fe admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.543565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e520f1d390c94369b065721b32ba3131'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.546792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.547412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.547725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.548558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.549398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.551342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.551493 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e520f1d390c94369b065721b32ba3131'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.552026 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e520f1d390c94369b065721b32ba3131'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.552623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e520f1d390c94369b065721b32ba3131'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.560346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5fec1aa8-0b39-496a-b644-a1ab2f3b1947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e520f1d390c94369b065721b32ba3131'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:50.582083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1191/2348] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:50 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:20:50.588250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.590193 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:50.590768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1158/2349] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:20:50 2022] DELETE /identity/v3/users/e520f1d390c94369b065721b32ba3131 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:50.595227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba7a5-0ef0-4d58-ade5-d593a2ecb0f5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.595777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba7a5-0ef0-4d58-ade5-d593a2ecb0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.596233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ba7a5-0ef0-4d58-ade5-d593a2ecb0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.619710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f34ba7a5-0ef0-4d58-ade5-d593a2ecb0f5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:50.621109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f34ba7a5-0ef0-4d58-ade5-d593a2ecb0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:50.666741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49d0c7-5fb9-417b-8ddd-e9e50a4859a5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.683004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1159/2350] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:20:50.693782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ba7a5-0ef0-4d58-ade5-d593a2ecb0f5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.695193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f34ba7a5-0ef0-4d58-ade5-d593a2ecb0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:50.708349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:50.728340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0890-d828-4aeb-b1e0-77f28861fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.728961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0890-d828-4aeb-b1e0-77f28861fa61 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.729370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0890-d828-4aeb-b1e0-77f28861fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.729783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0890-d828-4aeb-b1e0-77f28861fa61 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.730542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce0890-d828-4aeb-b1e0-77f28861fa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.732673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce0890-d828-4aeb-b1e0-77f28861fa61 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.762450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ba7a5-0ef0-4d58-ade5-d593a2ecb0f5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.766451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022f94-3a03-403e-bfcf-a744317ad1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.767466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022f94-3a03-403e-bfcf-a744317ad1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.767804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022f94-3a03-403e-bfcf-a744317ad1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.768150 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022f94-3a03-403e-bfcf-a744317ad1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.773988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1192/2351] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:50 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:50.775207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0890-d828-4aeb-b1e0-77f28861fa61 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.779454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d022f94-3a03-403e-bfcf-a744317ad1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.781546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d022f94-3a03-403e-bfcf-a744317ad1b0 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.786202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0890-d828-4aeb-b1e0-77f28861fa61 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.791052 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8481c1-78f0-446f-994e-b1bfbbb92aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.791652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8481c1-78f0-446f-994e-b1bfbbb92aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.791981 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8481c1-78f0-446f-994e-b1bfbbb92aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.792264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8481c1-78f0-446f-994e-b1bfbbb92aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.792909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8481c1-78f0-446f-994e-b1bfbbb92aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.793374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1160/2352] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:20:50.794703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8481c1-78f0-446f-994e-b1bfbbb92aaf admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.809110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1193/2353] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:50.810333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022f94-3a03-403e-bfcf-a744317ad1b0 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.821512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022f94-3a03-403e-bfcf-a744317ad1b0 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.826736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0f986-e974-49cd-94a0-5fefc3292e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.827447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0f986-e974-49cd-94a0-5fefc3292e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.827805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0f986-e974-49cd-94a0-5fefc3292e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.828235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0f986-e974-49cd-94a0-5fefc3292e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.828959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0f986-e974-49cd-94a0-5fefc3292e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.830630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0f986-e974-49cd-94a0-5fefc3292e7b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.850525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1161/2354] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:50.851731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8481c1-78f0-446f-994e-b1bfbbb92aaf admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:50.863664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8481c1-78f0-446f-994e-b1bfbbb92aaf admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:50.873597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:50.874281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.874560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.874838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] PATH_INFO: `/v3/projects/dc82e3921a544b4697a20d83661562c2/users/5bcb6826e1864f9183058df1a6714824/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.897092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc82e3921a544b4697a20d83661562c2, user_id=5bcb6826e1864f9183058df1a6714824, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:50.898307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:50.908904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:50.917134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1194/2355] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:50 2022] PUT /identity/v3/projects/dc82e3921a544b4697a20d83661562c2/users/5bcb6826e1864f9183058df1a6714824/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:20:50.932774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe804-2349-4065-96b7-18aedc508900 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:50.933205 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe804-2349-4065-96b7-18aedc508900 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:50.933606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbe804-2349-4065-96b7-18aedc508900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:50.983911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5bdbe804-2349-4065-96b7-18aedc508900 None None] MFA Rules not processed for user `5bcb6826e1864f9183058df1a6714824`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:50.987571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5bdbe804-2349-4065-96b7-18aedc508900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.053900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.055791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.143073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1162/2356] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:51.144114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe804-2349-4065-96b7-18aedc508900 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.157855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbe804-2349-4065-96b7-18aedc508900 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.164234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e496b8-3756-4a4e-b267-9ae334214107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.164958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e496b8-3756-4a4e-b267-9ae334214107 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.165609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e496b8-3756-4a4e-b267-9ae334214107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.165609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e496b8-3756-4a4e-b267-9ae334214107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.166376 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e496b8-3756-4a4e-b267-9ae334214107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.168589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e496b8-3756-4a4e-b267-9ae334214107 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.170918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29545063-ed98-4d17-9470-37b5c4f7044a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.181070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.181821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.182186 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.182475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] PATH_INFO: `/v3/projects/fa07e1e2db7242779d5cb78246078820` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.183708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa07e1e2db7242779d5cb78246078820)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.185700 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.203030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1163/2357] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:20:51 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:20:51.205658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e496b8-3756-4a4e-b267-9ae334214107 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.255895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa07e1e2db7242779d5cb78246078820', 'request_id': 'req-09ad2d59-cd3d-4f58-b748-5403a51900bd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:51.262820 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa07e1e2db7242779d5cb78246078820', 'request_id': 'req-09ad2d59-cd3d-4f58-b748-5403a51900bd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:51.275247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa07e1e2db7242779d5cb78246078820', 'request_id': 'req-09ad2d59-cd3d-4f58-b748-5403a51900bd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:51.278264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e496b8-3756-4a4e-b267-9ae334214107 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.288499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] The token cache is being invalidate because project fa07e1e2db7242779d5cb78246078820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:20:51.288885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:51.289717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:20:51.299225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1195/2358] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:20:51 2022] DELETE /identity/v3/projects/fa07e1e2db7242779d5cb78246078820 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:20:51.313016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:51.365678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9551-c0aa-4c5a-9f83-57319ee530c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.367023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9551-c0aa-4c5a-9f83-57319ee530c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.367887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9551-c0aa-4c5a-9f83-57319ee530c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.368483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9551-c0aa-4c5a-9f83-57319ee530c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.369436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9551-c0aa-4c5a-9f83-57319ee530c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.373648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9551-c0aa-4c5a-9f83-57319ee530c5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.416158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1164/2359] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:20:51 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:20:51.417359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.418984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.449276 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2d59-cd3d-4f58-b748-5403a51900bd admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.455919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e39556-65f5-4c8d-ab95-34a9043a2e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.456768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e39556-65f5-4c8d-ab95-34a9043a2e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.457154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e39556-65f5-4c8d-ab95-34a9043a2e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.457530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e39556-65f5-4c8d-ab95-34a9043a2e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.458313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e39556-65f5-4c8d-ab95-34a9043a2e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.460377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e39556-65f5-4c8d-ab95-34a9043a2e82 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.495347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1196/2360] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:51.500690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9551-c0aa-4c5a-9f83-57319ee530c5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.512028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9551-c0aa-4c5a-9f83-57319ee530c5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.517685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295518d-528e-4af7-962b-36711edfe0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.518337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295518d-528e-4af7-962b-36711edfe0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.518620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295518d-528e-4af7-962b-36711edfe0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.518895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295518d-528e-4af7-962b-36711edfe0f8 admin admin] PATH_INFO: `/v3/projects/bf12e7ccaca2451d8e0f8cecfc37a717/users/2c757c2ac78e418290ba0f4101689c47/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.535156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295518d-528e-4af7-962b-36711edfe0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf12e7ccaca2451d8e0f8cecfc37a717, user_id=2c757c2ac78e418290ba0f4101689c47, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.537805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d295518d-528e-4af7-962b-36711edfe0f8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.554810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1165/2361] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:51 2022] PUT /identity/v3/projects/bf12e7ccaca2451d8e0f8cecfc37a717/users/2c757c2ac78e418290ba0f4101689c47/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:51.558602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e39556-65f5-4c8d-ab95-34a9043a2e82 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.569284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e39556-65f5-4c8d-ab95-34a9043a2e82 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.627144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d25531-078a-4650-b553-185ec0a3d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.627745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d25531-078a-4650-b553-185ec0a3d14b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.628057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d25531-078a-4650-b553-185ec0a3d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.628331 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d25531-078a-4650-b553-185ec0a3d14b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.628965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d25531-078a-4650-b553-185ec0a3d14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.630547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d25531-078a-4650-b553-185ec0a3d14b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.641082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1197/2362] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:20:51.645699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295518d-528e-4af7-962b-36711edfe0f8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.656657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295518d-528e-4af7-962b-36711edfe0f8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.662136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.662830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.663147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.663427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] PATH_INFO: `/v3/projects/bf12e7ccaca2451d8e0f8cecfc37a717/users/2c757c2ac78e418290ba0f4101689c47/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.665545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf12e7ccaca2451d8e0f8cecfc37a717, user_id=2c757c2ac78e418290ba0f4101689c47, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.668593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.681287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1166/2363] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:20:51 2022] PUT /identity/v3/projects/bf12e7ccaca2451d8e0f8cecfc37a717/users/2c757c2ac78e418290ba0f4101689c47/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:20:51.692539 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440680b-01ec-4ae4-92e0-e8a16655b875 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.692858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440680b-01ec-4ae4-92e0-e8a16655b875 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.693135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440680b-01ec-4ae4-92e0-e8a16655b875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.726181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:20:51.738054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6440680b-01ec-4ae4-92e0-e8a16655b875 None None] MFA Rules not processed for user `2c757c2ac78e418290ba0f4101689c47`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:20:51.740181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6440680b-01ec-4ae4-92e0-e8a16655b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.830529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1198/2364] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:20:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:20:51.838025 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:51.839744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.898145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d8d25-811e-4e9f-80a5-198198ff128f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:51.901766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:51.902365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:51.902639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:51.902910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:51.904688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:51.970826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:51.972439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:51.981840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1167/2365] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:20:59.522527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440680b-01ec-4ae4-92e0-e8a16655b875 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:20:59.524058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6440680b-01ec-4ae4-92e0-e8a16655b875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:20:59.537154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440680b-01ec-4ae4-92e0-e8a16655b875 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:20:59.540963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43127014-7db6-4978-9d23-a169c216bf77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:20:59.541581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43127014-7db6-4978-9d23-a169c216bf77 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:20:59.541862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43127014-7db6-4978-9d23-a169c216bf77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:20:59.542138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43127014-7db6-4978-9d23-a169c216bf77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:20:59.552578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43127014-7db6-4978-9d23-a169c216bf77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:20:59.554012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43127014-7db6-4978-9d23-a169c216bf77 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:20:59.565203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1199/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:20:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:01.977459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:05.545108 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:05.614496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a4bf-38c3-4562-8054-922e13f3de89 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:05.618868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:05.619536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:05.619821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:05.620094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] PATH_INFO: `/v3/users/5bcb6826e1864f9183058df1a6714824` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:05.621222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcb6826e1864f9183058df1a6714824)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:05.623170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:05.675921 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcb6826e1864f9183058df1a6714824'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:05.685805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcb6826e1864f9183058df1a6714824'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:05.686479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcb6826e1864f9183058df1a6714824'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:05.688213 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcb6826e1864f9183058df1a6714824'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:05.696778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcb6826e1864f9183058df1a6714824'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:05.726759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1168/2367] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:21:05 2022] DELETE /identity/v3/users/5bcb6826e1864f9183058df1a6714824 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:05.731233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2f73e-3314-4d4b-aa41-610a988866a0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:05.731687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2f73e-3314-4d4b-aa41-610a988866a0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:05.731825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2f73e-3314-4d4b-aa41-610a988866a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:05.751584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-51c2f73e-3314-4d4b-aa41-610a988866a0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:05.752815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-51c2f73e-3314-4d4b-aa41-610a988866a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:05.820701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1200/2368] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:05.830368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:05.831877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:05.896825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c5398-4833-4e84-b34b-9f2bd1c1f65f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:05.901210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba2535-a6b6-4465-85d6-b757c0dff0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:05.901526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2535-a6b6-4465-85d6-b757c0dff0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:05.901878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2535-a6b6-4465-85d6-b757c0dff0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:05.902228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba2535-a6b6-4465-85d6-b757c0dff0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:05.914621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba2535-a6b6-4465-85d6-b757c0dff0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:05.914621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba2535-a6b6-4465-85d6-b757c0dff0d7 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:05.924092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1169/2369] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:06.309774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2f73e-3314-4d4b-aa41-610a988866a0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:06.311272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-51c2f73e-3314-4d4b-aa41-610a988866a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:06.323859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2f73e-3314-4d4b-aa41-610a988866a0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:06.329204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:06.329880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:06.333746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:06.333746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] PATH_INFO: `/v3/projects/dc82e3921a544b4697a20d83661562c2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:06.333746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc82e3921a544b4697a20d83661562c2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:06.333746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:06.384806 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc82e3921a544b4697a20d83661562c2', 'request_id': 'req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.391930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc82e3921a544b4697a20d83661562c2', 'request_id': 'req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.400705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc82e3921a544b4697a20d83661562c2', 'request_id': 'req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.412475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] The token cache is being invalidate because project dc82e3921a544b4697a20d83661562c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:21:06.412991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.413752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.415299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1201/2370] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:21:06 2022] DELETE /identity/v3/projects/dc82e3921a544b4697a20d83661562c2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:06.419443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba2535-a6b6-4465-85d6-b757c0dff0d7 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:06.430029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba2535-a6b6-4465-85d6-b757c0dff0d7 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:06.452040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:06.503755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:06.504330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:06.504613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:06.504886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] PATH_INFO: `/v3/users/2c757c2ac78e418290ba0f4101689c47` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:06.506103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c757c2ac78e418290ba0f4101689c47)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:06.508303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:06.564717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c757c2ac78e418290ba0f4101689c47'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.576549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c757c2ac78e418290ba0f4101689c47'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.577308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c757c2ac78e418290ba0f4101689c47'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.578052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c757c2ac78e418290ba0f4101689c47'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.586500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-17b36427-4b74-4c19-aadc-9bf3e8184b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c757c2ac78e418290ba0f4101689c47'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:06.613021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1170/2371] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:21:06 2022] DELETE /identity/v3/users/2c757c2ac78e418290ba0f4101689c47 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:07.095862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:07.097892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:07.137936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968bbb0-82a4-4926-9ae4-1e25aaff1ee6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:07.144293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:07.269594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:07.270363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.270512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.270785 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] PATH_INFO: `/v3/projects/bf12e7ccaca2451d8e0f8cecfc37a717` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.272074 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf12e7ccaca2451d8e0f8cecfc37a717)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:07.274351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:07.333365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf12e7ccaca2451d8e0f8cecfc37a717', 'request_id': 'req-a3603490-5521-4097-84e4-4e168ff65db7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:07.340424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf12e7ccaca2451d8e0f8cecfc37a717', 'request_id': 'req-a3603490-5521-4097-84e4-4e168ff65db7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:07.348147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf12e7ccaca2451d8e0f8cecfc37a717', 'request_id': 'req-a3603490-5521-4097-84e4-4e168ff65db7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:07.358685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] The token cache is being invalidate because project bf12e7ccaca2451d8e0f8cecfc37a717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:21:07.358974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:07.360189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a3603490-5521-4097-84e4-4e168ff65db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:07.361690 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1202/2372] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:21:07 2022] DELETE /identity/v3/projects/bf12e7ccaca2451d8e0f8cecfc37a717 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:07.367624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63149c3-ebb4-412f-b0ba-5b551148ed41 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.367910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63149c3-ebb4-412f-b0ba-5b551148ed41 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.368216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63149c3-ebb4-412f-b0ba-5b551148ed41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.388336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c63149c3-ebb4-412f-b0ba-5b551148ed41 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:07.389539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c63149c3-ebb4-412f-b0ba-5b551148ed41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:07.450289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1171/2373] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:07.458838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786def-47cc-40b2-958c-10b44ae8e04c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.459171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786def-47cc-40b2-958c-10b44ae8e04c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.459456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786def-47cc-40b2-958c-10b44ae8e04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.480270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3c786def-47cc-40b2-958c-10b44ae8e04c None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:07.481671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3c786def-47cc-40b2-958c-10b44ae8e04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:07.491084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1203/2374] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:07.495230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63149c3-ebb4-412f-b0ba-5b551148ed41 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:07.507387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63149c3-ebb4-412f-b0ba-5b551148ed41 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:07.511900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:07.512495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.512770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.513043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.513682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:21:07.513979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:07.515752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:07.527809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1172/2375] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:21:07.533100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786def-47cc-40b2-958c-10b44ae8e04c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:07.542289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786def-47cc-40b2-958c-10b44ae8e04c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:07.547505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665933-4d39-4809-9661-973ed0edbe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:07.548111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665933-4d39-4809-9661-973ed0edbe48 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.548388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665933-4d39-4809-9661-973ed0edbe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.548663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e665933-4d39-4809-9661-973ed0edbe48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.549294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e665933-4d39-4809-9661-973ed0edbe48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:07.551258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e665933-4d39-4809-9661-973ed0edbe48 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:07.608138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1204/2376] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:21:07 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:21:07.612677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:07.624030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3a62-3a5a-48e6-88c2-966d5d90dd27 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:07.654411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:07.690425 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d8f74-2554-4cc2-ae93-868fb9d9931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:07.691073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8f74-2554-4cc2-ae93-868fb9d9931c admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.691359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8f74-2554-4cc2-ae93-868fb9d9931c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.691638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8f74-2554-4cc2-ae93-868fb9d9931c admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.692307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d8f74-2554-4cc2-ae93-868fb9d9931c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:07.694264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d8f74-2554-4cc2-ae93-868fb9d9931c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:07.721245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1173/2377] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:21:07 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:21:07.722440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665933-4d39-4809-9661-973ed0edbe48 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:07.732924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e665933-4d39-4809-9661-973ed0edbe48 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:07.737908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d60c03-0c20-4e16-ae1f-95b8825f212d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:07.738519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60c03-0c20-4e16-ae1f-95b8825f212d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.738803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60c03-0c20-4e16-ae1f-95b8825f212d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.739202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d60c03-0c20-4e16-ae1f-95b8825f212d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.739851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d60c03-0c20-4e16-ae1f-95b8825f212d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:07.741454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d60c03-0c20-4e16-ae1f-95b8825f212d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:07.753490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1205/2378] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:21:07.757593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d8f74-2554-4cc2-ae93-868fb9d9931c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:07.768140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d8f74-2554-4cc2-ae93-868fb9d9931c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:07.773654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc077798-10d3-4fa6-a6d6-039885899035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:07.774265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077798-10d3-4fa6-a6d6-039885899035 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.774552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077798-10d3-4fa6-a6d6-039885899035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.774837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc077798-10d3-4fa6-a6d6-039885899035 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.775546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc077798-10d3-4fa6-a6d6-039885899035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:07.777176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc077798-10d3-4fa6-a6d6-039885899035 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:07.789200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1174/2379] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:21:07.793480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d60c03-0c20-4e16-ae1f-95b8825f212d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:07.804856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d60c03-0c20-4e16-ae1f-95b8825f212d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:07.809734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:07.810403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.810902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.811242 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] PATH_INFO: `/v3/projects/0733f37bf2ad47e3b8316168205fa71e/users/e0d12d9253404373b9169d2160622003/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.827422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0733f37bf2ad47e3b8316168205fa71e, user_id=e0d12d9253404373b9169d2160622003, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:07.830620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:07.845475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1206/2380] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:21:07 2022] PUT /identity/v3/projects/0733f37bf2ad47e3b8316168205fa71e/users/e0d12d9253404373b9169d2160622003/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:07.856372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad71df-173f-4987-aa34-48097d48e93f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:07.856688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad71df-173f-4987-aa34-48097d48e93f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:07.857094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad71df-173f-4987-aa34-48097d48e93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:07.900332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d9ad71df-173f-4987-aa34-48097d48e93f None None] MFA Rules not processed for user `e0d12d9253404373b9169d2160622003`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:07.901542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d9ad71df-173f-4987-aa34-48097d48e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:07.970447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1175/2381] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:07.981688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:07.983465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:08.026307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:08.047979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e024a-499e-4970-8add-801bd5072609 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:08.051770 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5aa30c-f750-406c-b13d-e67b525f8358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:08.052414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aa30c-f750-406c-b13d-e67b525f8358 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:08.052694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aa30c-f750-406c-b13d-e67b525f8358 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:08.052972 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5aa30c-f750-406c-b13d-e67b525f8358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:08.061492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5aa30c-f750-406c-b13d-e67b525f8358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:08.063065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5aa30c-f750-406c-b13d-e67b525f8358 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:08.072513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1207/2382] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:17.966657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:18.068012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=10 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:19.434828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad71df-173f-4987-aa34-48097d48e93f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:19.436399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d9ad71df-173f-4987-aa34-48097d48e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:19.501639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad71df-173f-4987-aa34-48097d48e93f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:19.505703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:19.506281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:19.506561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:19.506836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] PATH_INFO: `/v3/users/e47449e631134964b72a7ee04297b7a1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:19.507986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47449e631134964b72a7ee04297b7a1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:19.509911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:19.522870 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5aa30c-f750-406c-b13d-e67b525f8358 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:19.534671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5aa30c-f750-406c-b13d-e67b525f8358 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:19.540990 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:19.541781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:19.542268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:19.542697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] PATH_INFO: `/v3/users/e0d12d9253404373b9169d2160622003` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:19.544393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d12d9253404373b9169d2160622003)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:19.547296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:19.559820 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47449e631134964b72a7ee04297b7a1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.568540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47449e631134964b72a7ee04297b7a1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.569151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47449e631134964b72a7ee04297b7a1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.569812 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47449e631134964b72a7ee04297b7a1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.577897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-0b99b876-d293-496f-b087-706d7559e03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47449e631134964b72a7ee04297b7a1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.595241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d12d9253404373b9169d2160622003'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.600284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1176/2383] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:21:19 2022] DELETE /identity/v3/users/e47449e631134964b72a7ee04297b7a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:19.601745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e28f72-4033-4701-a9d8-77ce6ac00df6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:19.602028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e28f72-4033-4701-a9d8-77ce6ac00df6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:19.602306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e28f72-4033-4701-a9d8-77ce6ac00df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:19.606616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d12d9253404373b9169d2160622003'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.607284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d12d9253404373b9169d2160622003'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.608006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d12d9253404373b9169d2160622003'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.621541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-79dcc0a0-768a-4128-ab25-adb8e9ce160c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d12d9253404373b9169d2160622003'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:19.623245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e4e28f72-4033-4701-a9d8-77ce6ac00df6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:19.624526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e4e28f72-4033-4701-a9d8-77ce6ac00df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:19.635201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1208/2384] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:21:19 2022] DELETE /identity/v3/users/e0d12d9253404373b9169d2160622003 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:21:19.639383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a49d4-e179-46d5-813c-283e626c08b7 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:19.639667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a49d4-e179-46d5-813c-283e626c08b7 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:19.639988 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a49d4-e179-46d5-813c-283e626c08b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:19.659667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e57a49d4-e179-46d5-813c-283e626c08b7 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:19.660863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e57a49d4-e179-46d5-813c-283e626c08b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:19.686389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1177/2385] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:19.697270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e28f72-4033-4701-a9d8-77ce6ac00df6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:19.698609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e4e28f72-4033-4701-a9d8-77ce6ac00df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:19.725954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:19.726388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1209/2386] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:19.739675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a49d4-e179-46d5-813c-283e626c08b7 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:19.741110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e57a49d4-e179-46d5-813c-283e626c08b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:19.769245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e28f72-4033-4701-a9d8-77ce6ac00df6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:19.828305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:19.828514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a49d4-e179-46d5-813c-283e626c08b7 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:19.829019 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:19.829302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:19.829581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:19.833150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:19.833856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:19.834213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:19.834679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:19.840510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:19.841947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:19.847059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:19.849508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:19.855649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1178/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:21:19.863750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1210/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:20.423600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:20.425237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:20.449326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76963e91-fc69-42fa-95db-5763a465c6a2 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:20.456060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:20.456703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:20.456988 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:20.457266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] PATH_INFO: `/v3/projects/1373cd48c8e3483cbe1edfbfe875cf10` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:20.458512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1373cd48c8e3483cbe1edfbfe875cf10)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:20.460663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:20.509198 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:20.511061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:20.530828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e193c4-0b7e-4e60-b30e-26f2c689a068 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:20.540580 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1373cd48c8e3483cbe1edfbfe875cf10', 'request_id': 'req-8854a2d1-bb54-4c9c-9368-3c5331826867'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.549255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1373cd48c8e3483cbe1edfbfe875cf10', 'request_id': 'req-8854a2d1-bb54-4c9c-9368-3c5331826867'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.553191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:20.559266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1373cd48c8e3483cbe1edfbfe875cf10', 'request_id': 'req-8854a2d1-bb54-4c9c-9368-3c5331826867'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.575260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] The token cache is being invalidate because project 1373cd48c8e3483cbe1edfbfe875cf10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:21:20.575642 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.576372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8854a2d1-bb54-4c9c-9368-3c5331826867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.578984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1179/2389] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:21:20 2022] DELETE /identity/v3/projects/1373cd48c8e3483cbe1edfbfe875cf10 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:20.583762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914c0bb-b4bc-4481-9729-ffa6cecb03df None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:20.584156 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914c0bb-b4bc-4481-9729-ffa6cecb03df None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:20.584513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914c0bb-b4bc-4481-9729-ffa6cecb03df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:20.609137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5914c0bb-b4bc-4481-9729-ffa6cecb03df None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:20.610492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5914c0bb-b4bc-4481-9729-ffa6cecb03df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:20.612732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:20.613369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:20.613681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:20.613918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] PATH_INFO: `/v3/projects/0733f37bf2ad47e3b8316168205fa71e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:20.615241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0733f37bf2ad47e3b8316168205fa71e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:20.617187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:20.620915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1180/2390] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:21:20.631375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec5f09-2501-40c5-8ed2-3eebb87a5639 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:20.631873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec5f09-2501-40c5-8ed2-3eebb87a5639 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:20.634415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec5f09-2501-40c5-8ed2-3eebb87a5639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:20.663793 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-96ec5f09-2501-40c5-8ed2-3eebb87a5639 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:20.665038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-96ec5f09-2501-40c5-8ed2-3eebb87a5639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:20.674224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1181/2391] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:21:20.678242 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec5f09-2501-40c5-8ed2-3eebb87a5639 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:20.685613 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0733f37bf2ad47e3b8316168205fa71e', 'request_id': 'req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.688036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec5f09-2501-40c5-8ed2-3eebb87a5639 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:20.692564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0733f37bf2ad47e3b8316168205fa71e', 'request_id': 'req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.701212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0733f37bf2ad47e3b8316168205fa71e', 'request_id': 'req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.713636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] The token cache is being invalidate because project 0733f37bf2ad47e3b8316168205fa71e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:21:20.714069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.714749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:20.716801 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1211/2392] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:21:20 2022] DELETE /identity/v3/projects/0733f37bf2ad47e3b8316168205fa71e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:21:20.741452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:20.759185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:20.760147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:20.760906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:20.761283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:20.762120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:21:20.762631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:20.764564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:20.786408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1182/2393] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:21:20.788104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:20.789686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:20.808339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be2e1e-b363-4cdb-8a6a-5770b0e3488a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:20.816041 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba56f-a528-4459-9e86-812898d95f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:20.817097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba56f-a528-4459-9e86-812898d95f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:20.817625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba56f-a528-4459-9e86-812898d95f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:20.818124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba56f-a528-4459-9e86-812898d95f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:20.819103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ba56f-a528-4459-9e86-812898d95f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:20.822383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ba56f-a528-4459-9e86-812898d95f8c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:20.868985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1212/2394] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:21:20 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:21:20.869719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:20.884331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27611b-bacd-4c2d-af6b-ba043a4cf4c4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:20.964792 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad393-6491-4bf5-aad4-2b0f77074493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:20.965416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad393-6491-4bf5-aad4-2b0f77074493 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:20.965700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad393-6491-4bf5-aad4-2b0f77074493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:20.965979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad393-6491-4bf5-aad4-2b0f77074493 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:20.966796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad393-6491-4bf5-aad4-2b0f77074493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:20.968685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad393-6491-4bf5-aad4-2b0f77074493 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:20.996054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1183/2395] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:21:20 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:21:20.998173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba56f-a528-4459-9e86-812898d95f8c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:21.011943 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ba56f-a528-4459-9e86-812898d95f8c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:21.022855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322cded-aad6-48fe-8f97-37339d1fdfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:21.023681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cded-aad6-48fe-8f97-37339d1fdfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:21.024029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cded-aad6-48fe-8f97-37339d1fdfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:21.024372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cded-aad6-48fe-8f97-37339d1fdfd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:21.025103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322cded-aad6-48fe-8f97-37339d1fdfd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:21.026795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322cded-aad6-48fe-8f97-37339d1fdfd0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:21.042100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1213/2396] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:21:21.043497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad393-6491-4bf5-aad4-2b0f77074493 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:21.056553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad393-6491-4bf5-aad4-2b0f77074493 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:21.061784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2585c-be88-4130-9a00-90569f1b1e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:21.062624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2585c-be88-4130-9a00-90569f1b1e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:21.062915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2585c-be88-4130-9a00-90569f1b1e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:21.063224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2585c-be88-4130-9a00-90569f1b1e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:21.063889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2585c-be88-4130-9a00-90569f1b1e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:21.065525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2585c-be88-4130-9a00-90569f1b1e9b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:21.078087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1184/2397] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:21:21.083127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322cded-aad6-48fe-8f97-37339d1fdfd0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:21.097141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322cded-aad6-48fe-8f97-37339d1fdfd0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:21.101875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:21.102898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:21.103069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:21.103497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] PATH_INFO: `/v3/projects/419c4bbf4c4441e191fc0ccf8e05bea5/users/b40319d730f1416d93829dad05bfa7f7/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:21.122777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419c4bbf4c4441e191fc0ccf8e05bea5, user_id=b40319d730f1416d93829dad05bfa7f7, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:21.125634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:21.139345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1214/2398] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:21:21 2022] PUT /identity/v3/projects/419c4bbf4c4441e191fc0ccf8e05bea5/users/b40319d730f1416d93829dad05bfa7f7/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:21.152666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99556aee-dd2a-41d9-bc93-9440bc6fda59 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:21.153398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99556aee-dd2a-41d9-bc93-9440bc6fda59 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:21.153745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99556aee-dd2a-41d9-bc93-9440bc6fda59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:21.190486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-99556aee-dd2a-41d9-bc93-9440bc6fda59 None None] MFA Rules not processed for user `b40319d730f1416d93829dad05bfa7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:21.192663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-99556aee-dd2a-41d9-bc93-9440bc6fda59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:21.288776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1185/2399] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:21.300115 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:21.301937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:21.358071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:21.363425 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da5c09-0a47-4626-8946-00619f672b66 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:21.368906 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558adb36-a168-4afc-aded-434d066d7076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:21.369682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558adb36-a168-4afc-aded-434d066d7076 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:21.369925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558adb36-a168-4afc-aded-434d066d7076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:21.370534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558adb36-a168-4afc-aded-434d066d7076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:21.382142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558adb36-a168-4afc-aded-434d066d7076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:21.383620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558adb36-a168-4afc-aded-434d066d7076 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:21.396095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1215/2400] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:23.966427 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99556aee-dd2a-41d9-bc93-9440bc6fda59 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:24.020623 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:24.033208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99556aee-dd2a-41d9-bc93-9440bc6fda59 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:24.037684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:24.038314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:24.038596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:24.038873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] PATH_INFO: `/v3/users/b40319d730f1416d93829dad05bfa7f7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:24.040059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40319d730f1416d93829dad05bfa7f7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:24.041952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:24.088194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40319d730f1416d93829dad05bfa7f7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.095606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40319d730f1416d93829dad05bfa7f7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.096497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40319d730f1416d93829dad05bfa7f7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.097107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40319d730f1416d93829dad05bfa7f7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.104053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40319d730f1416d93829dad05bfa7f7'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.121985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1186/2401] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:21:23 2022] DELETE /identity/v3/users/b40319d730f1416d93829dad05bfa7f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:24.127034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3eba-70f5-42a8-9bb6-3afd76a7150a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:24.127485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3eba-70f5-42a8-9bb6-3afd76a7150a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:24.127693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c3eba-70f5-42a8-9bb6-3afd76a7150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:24.147109 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0b5c3eba-70f5-42a8-9bb6-3afd76a7150a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:24.148307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0b5c3eba-70f5-42a8-9bb6-3afd76a7150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:24.213238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1216/2402] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:24.223656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:24.225173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:24.283811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a9429-d461-49b4-8653-7929a31232d7 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:24.287677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec4f66-0ab0-47b2-9cd9-d63151547041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:24.288288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec4f66-0ab0-47b2-9cd9-d63151547041 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:24.288573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec4f66-0ab0-47b2-9cd9-d63151547041 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:24.288853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec4f66-0ab0-47b2-9cd9-d63151547041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:24.297841 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec4f66-0ab0-47b2-9cd9-d63151547041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:24.299291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec4f66-0ab0-47b2-9cd9-d63151547041 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:24.309093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1187/2403] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:24.588896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c3eba-70f5-42a8-9bb6-3afd76a7150a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:24.590324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0b5c3eba-70f5-42a8-9bb6-3afd76a7150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:24.612090 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c3eba-70f5-42a8-9bb6-3afd76a7150a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:24.622969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:24.623797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:24.624600 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:24.624986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] PATH_INFO: `/v3/projects/419c4bbf4c4441e191fc0ccf8e05bea5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:24.641344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=419c4bbf4c4441e191fc0ccf8e05bea5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:24.643317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:24.737197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419c4bbf4c4441e191fc0ccf8e05bea5', 'request_id': 'req-1c390476-a917-49bf-9535-5fcb76fe4fd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.759247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419c4bbf4c4441e191fc0ccf8e05bea5', 'request_id': 'req-1c390476-a917-49bf-9535-5fcb76fe4fd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.784407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419c4bbf4c4441e191fc0ccf8e05bea5', 'request_id': 'req-1c390476-a917-49bf-9535-5fcb76fe4fd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.814818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] The token cache is being invalidate because project 419c4bbf4c4441e191fc0ccf8e05bea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:21:24.815271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.816616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-1c390476-a917-49bf-9535-5fcb76fe4fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:24.821323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1217/2404] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:21:24 2022] DELETE /identity/v3/projects/419c4bbf4c4441e191fc0ccf8e05bea5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:24.823131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b82b5-35c0-47b2-9ac3-5b974981003d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:24.823444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b82b5-35c0-47b2-9ac3-5b974981003d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:24.823729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b82b5-35c0-47b2-9ac3-5b974981003d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:24.860460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d78b82b5-35c0-47b2-9ac3-5b974981003d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:24.861711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d78b82b5-35c0-47b2-9ac3-5b974981003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:24.952712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1188/2405] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:24.960766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5624-5645-4ea4-90f2-f069ea42cc78 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:24.961011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5624-5645-4ea4-90f2-f069ea42cc78 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:24.961260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe5624-5645-4ea4-90f2-f069ea42cc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:24.985147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1cfe5624-5645-4ea4-90f2-f069ea42cc78 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:24.986491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1cfe5624-5645-4ea4-90f2-f069ea42cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:24.994912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1218/2406] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:24.999984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b82b5-35c0-47b2-9ac3-5b974981003d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:25.010691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b82b5-35c0-47b2-9ac3-5b974981003d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:25.015737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:25.016352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:25.016641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:25.016920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:25.017600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:21:25.017908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:25.019529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:25.028601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:25.036953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1189/2407] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:21:25.038749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5624-5645-4ea4-90f2-f069ea42cc78 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:25.049344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe5624-5645-4ea4-90f2-f069ea42cc78 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:25.054442 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba57ed-810c-432d-b334-43beccedaca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:25.055071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba57ed-810c-432d-b334-43beccedaca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:25.055357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba57ed-810c-432d-b334-43beccedaca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:25.055632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba57ed-810c-432d-b334-43beccedaca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:25.056267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba57ed-810c-432d-b334-43beccedaca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:25.058164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba57ed-810c-432d-b334-43beccedaca7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:25.090017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1219/2408] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:21:25 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:21:25.091238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:25.103083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98882d-0f2e-41da-a202-3dc0d8c02913 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:25.176510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcce98-f0a0-41df-be63-7f7e5f083529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:25.177134 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcce98-f0a0-41df-be63-7f7e5f083529 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:25.177418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcce98-f0a0-41df-be63-7f7e5f083529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:25.177698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcce98-f0a0-41df-be63-7f7e5f083529 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:25.178335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcce98-f0a0-41df-be63-7f7e5f083529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:25.180387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcce98-f0a0-41df-be63-7f7e5f083529 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:25.214148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1190/2409] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:21:25 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:21:25.215494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba57ed-810c-432d-b334-43beccedaca7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:25.235755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba57ed-810c-432d-b334-43beccedaca7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:25.241319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998d9b6-bc8e-43e6-896d-9f540e5eaf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:25.241944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d9b6-bc8e-43e6-896d-9f540e5eaf63 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:25.242229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d9b6-bc8e-43e6-896d-9f540e5eaf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:25.242513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998d9b6-bc8e-43e6-896d-9f540e5eaf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:25.243321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998d9b6-bc8e-43e6-896d-9f540e5eaf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:25.245102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998d9b6-bc8e-43e6-896d-9f540e5eaf63 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:25.257158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1220/2410] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:21:25.260965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcce98-f0a0-41df-be63-7f7e5f083529 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:25.272054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcce98-f0a0-41df-be63-7f7e5f083529 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:25.278244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab1e8d-bcf3-40ef-aa1c-9e99cb1be149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:25.279488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab1e8d-bcf3-40ef-aa1c-9e99cb1be149 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:25.280182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab1e8d-bcf3-40ef-aa1c-9e99cb1be149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:25.280182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab1e8d-bcf3-40ef-aa1c-9e99cb1be149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:25.280984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab1e8d-bcf3-40ef-aa1c-9e99cb1be149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:25.284461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab1e8d-bcf3-40ef-aa1c-9e99cb1be149 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:25.297439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1191/2411] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:21:25.301519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998d9b6-bc8e-43e6-896d-9f540e5eaf63 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:25.314256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998d9b6-bc8e-43e6-896d-9f540e5eaf63 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:25.319412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:25.320179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:25.320822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:25.320822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] PATH_INFO: `/v3/projects/7765c7682fbd448bacf4dd5fb8dee0d3/users/a8d2bb388e2645ccac2a8753c38966b3/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:25.338363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7765c7682fbd448bacf4dd5fb8dee0d3, user_id=a8d2bb388e2645ccac2a8753c38966b3, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:25.341191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:25.359103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1221/2412] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:21:25 2022] PUT /identity/v3/projects/7765c7682fbd448bacf4dd5fb8dee0d3/users/a8d2bb388e2645ccac2a8753c38966b3/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:25.369442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde260c-8176-4e96-a382-2b1f02f2200f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:25.369731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde260c-8176-4e96-a382-2b1f02f2200f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:25.370016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde260c-8176-4e96-a382-2b1f02f2200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:25.404617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9dde260c-8176-4e96-a382-2b1f02f2200f None None] MFA Rules not processed for user `a8d2bb388e2645ccac2a8753c38966b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:25.405958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9dde260c-8176-4e96-a382-2b1f02f2200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:25.495135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1192/2413] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:25.507096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:25.508794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:25.524356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:25.572298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bc29-58e0-40d7-84f8-113e852a3b9d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:25.576260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d67fc-7f95-41d8-b171-1497380a82cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a909fc6177e94d2fa6d38dad285e616a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:25.576869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d67fc-7f95-41d8-b171-1497380a82cb service glance] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:25.577793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d67fc-7f95-41d8-b171-1497380a82cb service glance] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:25.578069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d67fc-7f95-41d8-b171-1497380a82cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:25.586619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d67fc-7f95-41d8-b171-1497380a82cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:25.588068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d67fc-7f95-41d8-b171-1497380a82cb service glance] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:25.598432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1222/2414] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:29.556621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde260c-8176-4e96-a382-2b1f02f2200f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:29.558938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9dde260c-8176-4e96-a382-2b1f02f2200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:29.637182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde260c-8176-4e96-a382-2b1f02f2200f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:29.641413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117b318-5289-4362-97d6-addb122b5a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:29.642040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b318-5289-4362-97d6-addb122b5a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:29.642323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b318-5289-4362-97d6-addb122b5a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:29.642601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b318-5289-4362-97d6-addb122b5a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:29.644539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5117b318-5289-4362-97d6-addb122b5a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:29.683418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:29.729926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117b318-5289-4362-97d6-addb122b5a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:29.731447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117b318-5289-4362-97d6-addb122b5a58 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:29.743112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1193/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:21:33.538587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065cb3-37a9-4d7c-994e-236cceec8bfb None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:33.539087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065cb3-37a9-4d7c-994e-236cceec8bfb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:33.539207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065cb3-37a9-4d7c-994e-236cceec8bfb None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:33.540606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1223/2416] 10.222.0.20 () {54 vars in 961 bytes} [Fri Sep 16 19:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:33.554890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc9c87-835e-4cc2-b505-10807d734c8d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:33.555420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc9c87-835e-4cc2-b505-10807d734c8d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:33.555705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc9c87-835e-4cc2-b505-10807d734c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:33.607044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b065cb3-37a9-4d7c-994e-236cceec8bfb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:33.608310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-cbfc9c87-835e-4cc2-b505-10807d734c8d None None] MFA Rules not processed for user `4af8934abda44859938a55bf4daf83d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:33.609748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cbfc9c87-835e-4cc2-b505-10807d734c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:33.611212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5b065cb3-37a9-4d7c-994e-236cceec8bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:33.630001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b065cb3-37a9-4d7c-994e-236cceec8bfb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:33.640680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:33.644538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:33.645013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:33.645508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:33.649761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:33.770359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1194/2417] 10.222.0.20 () {58 vars in 1058 bytes} [Fri Sep 16 19:21:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:33.778146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc9c87-835e-4cc2-b505-10807d734c8d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:33.790868 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc9c87-835e-4cc2-b505-10807d734c8d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:33.797696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af241c77-4805-406a-9fcf-ee784f9fc519 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:33.800049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241c77-4805-406a-9fcf-ee784f9fc519 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:33.800502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241c77-4805-406a-9fcf-ee784f9fc519 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:33.800963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241c77-4805-406a-9fcf-ee784f9fc519 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:33.803644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-af241c77-4805-406a-9fcf-ee784f9fc519 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:33.820738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af241c77-4805-406a-9fcf-ee784f9fc519 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:33.822461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af241c77-4805-406a-9fcf-ee784f9fc519 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:33.826303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:33.828592 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:33.835261 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1195/2418] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:21:33.856586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1224/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:21:37.608876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ade370-f69b-4e82-88cd-9856e8f7e811 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:37.608876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ade370-f69b-4e82-88cd-9856e8f7e811 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:37.608876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ade370-f69b-4e82-88cd-9856e8f7e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:37.629988 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-62ade370-f69b-4e82-88cd-9856e8f7e811 None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:37.631250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-62ade370-f69b-4e82-88cd-9856e8f7e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:37.687609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1196/2420] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:37.709524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:37.710920 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:37.783812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8cf74-a512-4932-91c8-89b91084c881 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:37.791764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06874ac-1f41-471f-b9ef-c75a0cccbf1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:37.792389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06874ac-1f41-471f-b9ef-c75a0cccbf1d service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:37.792699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06874ac-1f41-471f-b9ef-c75a0cccbf1d service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:37.792976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06874ac-1f41-471f-b9ef-c75a0cccbf1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:37.802577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06874ac-1f41-471f-b9ef-c75a0cccbf1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:37.804140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06874ac-1f41-471f-b9ef-c75a0cccbf1d service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:37.812259 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1225/2421] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:21:47.680890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=79 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:47.808980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=83 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:55.022405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ade370-f69b-4e82-88cd-9856e8f7e811 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:55.090568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ade370-f69b-4e82-88cd-9856e8f7e811 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:55.096362 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:55.097063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.097266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.097561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] PATH_INFO: `/v3/users/a8d2bb388e2645ccac2a8753c38966b3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.098685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d2bb388e2645ccac2a8753c38966b3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:55.100631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:55.147412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d2bb388e2645ccac2a8753c38966b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.157311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d2bb388e2645ccac2a8753c38966b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.157958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d2bb388e2645ccac2a8753c38966b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.158649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d2bb388e2645ccac2a8753c38966b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.166098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a4072718-4efc-471b-97a5-6825ce53b04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d2bb388e2645ccac2a8753c38966b3'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.184860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1197/2422] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:21:55 2022] DELETE /identity/v3/users/a8d2bb388e2645ccac2a8753c38966b3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:55.189901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d357c-9fa1-4bb2-acdb-b2e9e80b1c68 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.190486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d357c-9fa1-4bb2-acdb-b2e9e80b1c68 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.190486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d357c-9fa1-4bb2-acdb-b2e9e80b1c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.212268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ca2d357c-9fa1-4bb2-acdb-b2e9e80b1c68 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:55.213666 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ca2d357c-9fa1-4bb2-acdb-b2e9e80b1c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.256688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549a33-9d1d-4376-8eae-8149d1245af4 None None] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.257049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549a33-9d1d-4376-8eae-8149d1245af4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.257262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549a33-9d1d-4376-8eae-8149d1245af4 None None] PATH_INFO: `/` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.258770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1198/2423] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 19:21:55.264798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41a49-1274-4bca-bee2-3b484ba192b7 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.265676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41a49-1274-4bca-bee2-3b484ba192b7 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.266069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb41a49-1274-4bca-bee2-3b484ba192b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.290563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1226/2424] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:55.293842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-afb41a49-1274-4bca-bee2-3b484ba192b7 None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:55.293842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-afb41a49-1274-4bca-bee2-3b484ba192b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.303208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d357c-9fa1-4bb2-acdb-b2e9e80b1c68 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:55.304691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ca2d357c-9fa1-4bb2-acdb-b2e9e80b1c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.371189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d357c-9fa1-4bb2-acdb-b2e9e80b1c68 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:55.371941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1199/2425] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:21:55.375303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b9ed9-2250-4cc5-9a46-6e64c0e72537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:55.375915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b9ed9-2250-4cc5-9a46-6e64c0e72537 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.376197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b9ed9-2250-4cc5-9a46-6e64c0e72537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.376472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b9ed9-2250-4cc5-9a46-6e64c0e72537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.386227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb41a49-1274-4bca-bee2-3b484ba192b7 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:55.387885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-afb41a49-1274-4bca-bee2-3b484ba192b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.399391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b9ed9-2250-4cc5-9a46-6e64c0e72537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:55.400852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b9ed9-2250-4cc5-9a46-6e64c0e72537 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:55.407368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:55.411672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1227/2426] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:55.456149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb41a49-1274-4bca-bee2-3b484ba192b7 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:55.460272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08729ab1-31d6-4946-9ae1-218f50076133 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a909fc6177e94d2fa6d38dad285e616a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:55.460940 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08729ab1-31d6-4946-9ae1-218f50076133 service glance] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.461222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08729ab1-31d6-4946-9ae1-218f50076133 service glance] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.461497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08729ab1-31d6-4946-9ae1-218f50076133 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.473816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08729ab1-31d6-4946-9ae1-218f50076133 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:55.475267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08729ab1-31d6-4946-9ae1-218f50076133 service glance] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:55.487587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1200/2427] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:55.561160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c3821-fff4-428d-8366-28cf4f59f03a None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.561477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c3821-fff4-428d-8366-28cf4f59f03a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.561945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c3821-fff4-428d-8366-28cf4f59f03a None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.563671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1228/2428] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:55.569315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897292-18b7-4d38-a498-a9d24a5f26e3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.569604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897292-18b7-4d38-a498-a9d24a5f26e3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.569884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897292-18b7-4d38-a498-a9d24a5f26e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.594040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-16897292-18b7-4d38-a498-a9d24a5f26e3 None None] MFA Rules not processed for user `1c0ab0eca7de4bed89b5f292a52f8c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:55.595296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-16897292-18b7-4d38-a498-a9d24a5f26e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.602448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1201/2429] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:55.619973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c3821-fff4-428d-8366-28cf4f59f03a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:55.621723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-234c3821-fff4-428d-8366-28cf4f59f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.639686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c3821-fff4-428d-8366-28cf4f59f03a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:55.646599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1d6ba-744c-4ee2-af81-764730ecb848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:55.647288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d6ba-744c-4ee2-af81-764730ecb848 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.647574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d6ba-744c-4ee2-af81-764730ecb848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.647857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d6ba-744c-4ee2-af81-764730ecb848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.656347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1d6ba-744c-4ee2-af81-764730ecb848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:55.657784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1d6ba-744c-4ee2-af81-764730ecb848 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:55.665919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1229/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:55.736650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897292-18b7-4d38-a498-a9d24a5f26e3 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:55.738304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-16897292-18b7-4d38-a498-a9d24a5f26e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.762752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb932-0105-437b-b201-55492a6f54ec None None] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.762908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb932-0105-437b-b201-55492a6f54ec None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.763227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bb932-0105-437b-b201-55492a6f54ec None None] PATH_INFO: `/` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.765205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1230/2431] 10.222.0.20 () {54 vars in 921 bytes} [Fri Sep 16 19:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 19:21:55.771644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897292-18b7-4d38-a498-a9d24a5f26e3 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:55.771815 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa8d6-8423-416c-9704-8c00020ec098 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.771989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa8d6-8423-416c-9704-8c00020ec098 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.772279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fa8d6-8423-416c-9704-8c00020ec098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.776569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:55.777202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.777486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.777764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] PATH_INFO: `/v3/projects/7765c7682fbd448bacf4dd5fb8dee0d3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.778883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7765c7682fbd448bacf4dd5fb8dee0d3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:55.781008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:55.792535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-110fa8d6-8423-416c-9704-8c00020ec098 None None] MFA Rules not processed for user `c915a2b20a2c48a682ef08528e482b96`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:55.793733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-110fa8d6-8423-416c-9704-8c00020ec098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.804075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1231/2432] 10.222.0.20 () {58 vars in 1018 bytes} [Fri Sep 16 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:21:55.816548 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fa8d6-8423-416c-9704-8c00020ec098 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:55.826085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fa8d6-8423-416c-9704-8c00020ec098 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:55.830381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7765c7682fbd448bacf4dd5fb8dee0d3', 'request_id': 'req-191a633d-7868-4ae1-a37f-8e966fc317ce'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.836704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7765c7682fbd448bacf4dd5fb8dee0d3', 'request_id': 'req-191a633d-7868-4ae1-a37f-8e966fc317ce'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.845760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7765c7682fbd448bacf4dd5fb8dee0d3', 'request_id': 'req-191a633d-7868-4ae1-a37f-8e966fc317ce'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.857025 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] The token cache is being invalidate because project 7765c7682fbd448bacf4dd5fb8dee0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:21:55.857421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.858980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-191a633d-7868-4ae1-a37f-8e966fc317ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:21:55.860602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1202/2433] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:21:55 2022] DELETE /identity/v3/projects/7765c7682fbd448bacf4dd5fb8dee0d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:55.865110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe37fc-68e8-4940-87fb-384d35f05c59 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.865394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe37fc-68e8-4940-87fb-384d35f05c59 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.865670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe37fc-68e8-4940-87fb-384d35f05c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.884190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:55.885237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.885522 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.885719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c7fe37fc-68e8-4940-87fb-384d35f05c59 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:55.885843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.886920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c7fe37fc-68e8-4940-87fb-384d35f05c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.887518 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:55.927231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:55.959788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1203/2434] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:21:55.964510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc78616-5257-4643-95b6-60c1d5e9ef7f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:55.964859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc78616-5257-4643-95b6-60c1d5e9ef7f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:55.965762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc78616-5257-4643-95b6-60c1d5e9ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:55.968974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:55.970417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:55.982176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1232/2435] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:21:55.988084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3dc78616-5257-4643-95b6-60c1d5e9ef7f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:55.993488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3dc78616-5257-4643-95b6-60c1d5e9ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:56.001773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1204/2436] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:21:56.006036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:56.017739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5e5aa-71d9-4244-b2b4-013728c4830a service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:56.025584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:56.026209 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:56.026494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:56.026779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:56.027605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:21:56.027913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:56.030097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:56.042528 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1233/2437] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:21:56.047100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc78616-5257-4643-95b6-60c1d5e9ef7f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:56.056418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc78616-5257-4643-95b6-60c1d5e9ef7f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:56.061373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c521a6-9742-4a57-b5da-c45d70d84978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:56.061896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c521a6-9742-4a57-b5da-c45d70d84978 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:56.062199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c521a6-9742-4a57-b5da-c45d70d84978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:56.062472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c521a6-9742-4a57-b5da-c45d70d84978 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:56.063153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c521a6-9742-4a57-b5da-c45d70d84978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:56.065044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c521a6-9742-4a57-b5da-c45d70d84978 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:56.096918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1205/2438] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:21:56 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:21:56.100927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:56.111925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2b6e8-1ffa-468f-b323-f76e87acafef admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:56.175773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f6aaa-b0ea-4865-b0c5-0a6f9e2b8169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:56.176420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f6aaa-b0ea-4865-b0c5-0a6f9e2b8169 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:56.176702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f6aaa-b0ea-4865-b0c5-0a6f9e2b8169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:56.176977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f6aaa-b0ea-4865-b0c5-0a6f9e2b8169 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:56.177644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f6aaa-b0ea-4865-b0c5-0a6f9e2b8169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:56.179636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f6aaa-b0ea-4865-b0c5-0a6f9e2b8169 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:56.202556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1234/2439] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:21:56 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:21:56.206698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c521a6-9742-4a57-b5da-c45d70d84978 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:56.212629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:56.219681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c521a6-9742-4a57-b5da-c45d70d84978 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:56.226919 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf01a9-dfa2-44e6-ba29-816d3e54740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:56.227661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf01a9-dfa2-44e6-ba29-816d3e54740e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:56.228089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf01a9-dfa2-44e6-ba29-816d3e54740e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:56.228375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf01a9-dfa2-44e6-ba29-816d3e54740e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:56.229023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf01a9-dfa2-44e6-ba29-816d3e54740e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:56.230616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf01a9-dfa2-44e6-ba29-816d3e54740e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:56.243036 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1206/2440] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:21:56.245296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f6aaa-b0ea-4865-b0c5-0a6f9e2b8169 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:56.256076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f6aaa-b0ea-4865-b0c5-0a6f9e2b8169 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:56.260974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda5cc3-0d7e-4cfa-95c0-b6e47dc0d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:56.261604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5cc3-0d7e-4cfa-95c0-b6e47dc0d47e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:56.261884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5cc3-0d7e-4cfa-95c0-b6e47dc0d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:56.262159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5cc3-0d7e-4cfa-95c0-b6e47dc0d47e admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:56.262795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda5cc3-0d7e-4cfa-95c0-b6e47dc0d47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:56.265132 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda5cc3-0d7e-4cfa-95c0-b6e47dc0d47e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:56.278720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1235/2441] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:21:56.283578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf01a9-dfa2-44e6-ba29-816d3e54740e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:56.293519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf01a9-dfa2-44e6-ba29-816d3e54740e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:56.298388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:56.299020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:56.299318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:56.299596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] PATH_INFO: `/v3/projects/97491d54f3c94165a6e4186a47b76696/users/e6c531baa73a4d3f93e51c792b4e8e43/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:56.316274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97491d54f3c94165a6e4186a47b76696, user_id=e6c531baa73a4d3f93e51c792b4e8e43, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:56.318845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:56.332981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1207/2442] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:21:56 2022] PUT /identity/v3/projects/97491d54f3c94165a6e4186a47b76696/users/e6c531baa73a4d3f93e51c792b4e8e43/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:21:56.343287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3bbf6-3d64-48fd-8037-feff81401771 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:56.343835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3bbf6-3d64-48fd-8037-feff81401771 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:56.344107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3bbf6-3d64-48fd-8037-feff81401771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:56.372753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-66c3bbf6-3d64-48fd-8037-feff81401771 None None] MFA Rules not processed for user `e6c531baa73a4d3f93e51c792b4e8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:56.374558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-66c3bbf6-3d64-48fd-8037-feff81401771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:56.451935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1236/2443] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:21:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:56.465252 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:56.467157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:56.533943 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f2c5c-0bae-42c8-b942-1a1678a48ca6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:56.538259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:56.538913 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:56.539232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:56.539511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:56.549013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:56.551293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:56.562622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1208/2444] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:21:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:21:58.794223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81b83-1544-43d1-89eb-6bd04095a8c3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:58.794692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81b83-1544-43d1-89eb-6bd04095a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:58.794890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c81b83-1544-43d1-89eb-6bd04095a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:58.815731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d0c81b83-1544-43d1-89eb-6bd04095a8c3 None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:21:58.816939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d0c81b83-1544-43d1-89eb-6bd04095a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:58.830455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:21:58.875218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1237/2445] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:21:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:21:58.887228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:21:58.888708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:21:58.960815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcd2c3-c8c8-4bec-a411-cf2b8d0b00b7 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:21:58.965896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6bd9-8c6d-4c3b-be3c-d5333dd98c95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:21:58.966506 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6bd9-8c6d-4c3b-be3c-d5333dd98c95 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:21:58.967017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6bd9-8c6d-4c3b-be3c-d5333dd98c95 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:21:58.967302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf6bd9-8c6d-4c3b-be3c-d5333dd98c95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:21:58.975649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf6bd9-8c6d-4c3b-be3c-d5333dd98c95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:21:58.977357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf6bd9-8c6d-4c3b-be3c-d5333dd98c95 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:21:58.985965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1209/2446] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:21:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:22:08.867824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=16 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:22:08.983979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:22:27.795289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b5e3-968a-476f-915f-e491ad4a029a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:27.795778 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b5e3-968a-476f-915f-e491ad4a029a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:27.795969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791b5e3-968a-476f-915f-e491ad4a029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:27.816548 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5791b5e3-968a-476f-915f-e491ad4a029a None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:22:27.817844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5791b5e3-968a-476f-915f-e491ad4a029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:27.825352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1238/2447] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 19:22:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:22:27.838242 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6bd9-8c6d-4c3b-be3c-d5333dd98c95 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:27.849118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf6bd9-8c6d-4c3b-be3c-d5333dd98c95 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:27.854116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb01f8a-4121-406b-95f7-3bad05a20ad9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:27.854714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01f8a-4121-406b-95f7-3bad05a20ad9 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:27.855015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01f8a-4121-406b-95f7-3bad05a20ad9 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:27.855433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb01f8a-4121-406b-95f7-3bad05a20ad9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:27.864815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb01f8a-4121-406b-95f7-3bad05a20ad9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:27.866398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb01f8a-4121-406b-95f7-3bad05a20ad9 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:27.875168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1210/2448] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:22:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:22:34.062648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b5e3-968a-476f-915f-e491ad4a029a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:34.125014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791b5e3-968a-476f-915f-e491ad4a029a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:34.129969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:34.130589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:34.130866 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:34.131169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] PATH_INFO: `/v3/users/e6c531baa73a4d3f93e51c792b4e8e43` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:34.132285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c531baa73a4d3f93e51c792b4e8e43)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:34.134179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:34.178872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c531baa73a4d3f93e51c792b4e8e43'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.185976 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c531baa73a4d3f93e51c792b4e8e43'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.186579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c531baa73a4d3f93e51c792b4e8e43'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.187230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c531baa73a4d3f93e51c792b4e8e43'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.199945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c531baa73a4d3f93e51c792b4e8e43'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.212888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1239/2449] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:22:34 2022] DELETE /identity/v3/users/e6c531baa73a4d3f93e51c792b4e8e43 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:22:34.217364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bd400-dfe5-441d-a12e-a8fe5aadb681 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:34.218115 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bd400-dfe5-441d-a12e-a8fe5aadb681 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:34.218228 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bd400-dfe5-441d-a12e-a8fe5aadb681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:34.237829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-712bd400-dfe5-441d-a12e-a8fe5aadb681 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:22:34.239041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-712bd400-dfe5-441d-a12e-a8fe5aadb681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:34.296475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1211/2450] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:22:34.306288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:34.307709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:34.365284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee48db7-f7c3-43f4-a3f2-2895eea81b80 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:34.368884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3983d1-bc6c-43d0-b671-28ae72b7d8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:34.369484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3983d1-bc6c-43d0-b671-28ae72b7d8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:34.369761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3983d1-bc6c-43d0-b671-28ae72b7d8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:34.370033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3983d1-bc6c-43d0-b671-28ae72b7d8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:34.379643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3983d1-bc6c-43d0-b671-28ae72b7d8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:34.381053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3983d1-bc6c-43d0-b671-28ae72b7d8b7 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:34.390292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1240/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:22:34.648676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bd400-dfe5-441d-a12e-a8fe5aadb681 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:34.650305 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-712bd400-dfe5-441d-a12e-a8fe5aadb681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:34.664284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bd400-dfe5-441d-a12e-a8fe5aadb681 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:34.668967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:34.669607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:34.669888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:34.670165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] PATH_INFO: `/v3/projects/97491d54f3c94165a6e4186a47b76696` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:34.672078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] RBAC: Authorizing `identity:delete_project(project_id=97491d54f3c94165a6e4186a47b76696)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:34.674652 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:34.725353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97491d54f3c94165a6e4186a47b76696', 'request_id': 'req-e4002939-5e25-4521-bad8-0255fbbf27be'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.731463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97491d54f3c94165a6e4186a47b76696', 'request_id': 'req-e4002939-5e25-4521-bad8-0255fbbf27be'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.739218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97491d54f3c94165a6e4186a47b76696', 'request_id': 'req-e4002939-5e25-4521-bad8-0255fbbf27be'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.749198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] The token cache is being invalidate because project 97491d54f3c94165a6e4186a47b76696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:22:34.749482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.750087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e4002939-5e25-4521-bad8-0255fbbf27be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:34.751874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1212/2452] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:22:34 2022] DELETE /identity/v3/projects/97491d54f3c94165a6e4186a47b76696 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:22:34.756836 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0f89-15b3-4cea-97e0-bdbe252cc360 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:34.757124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0f89-15b3-4cea-97e0-bdbe252cc360 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:34.757403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea0f89-15b3-4cea-97e0-bdbe252cc360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:34.776390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-39ea0f89-15b3-4cea-97e0-bdbe252cc360 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:22:34.777582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-39ea0f89-15b3-4cea-97e0-bdbe252cc360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:34.787272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:22:34.838306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1241/2453] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:22:34.847029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3115a-6ec5-4779-8d2e-f4653c430fde None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:34.847315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3115a-6ec5-4779-8d2e-f4653c430fde None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:34.847590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3115a-6ec5-4779-8d2e-f4653c430fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:34.867059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-90c3115a-6ec5-4779-8d2e-f4653c430fde None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:22:34.868265 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-90c3115a-6ec5-4779-8d2e-f4653c430fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:34.876764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1213/2454] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:22:34.881054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea0f89-15b3-4cea-97e0-bdbe252cc360 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:34.891775 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea0f89-15b3-4cea-97e0-bdbe252cc360 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:34.896375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:34.896987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:34.897270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:34.897657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:34.898310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:22:34.898624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:34.900256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:34.912167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1242/2455] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:22:34.916289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3115a-6ec5-4779-8d2e-f4653c430fde None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:34.925572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3115a-6ec5-4779-8d2e-f4653c430fde None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:34.930087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1725fb5-5951-49c9-b395-64f20e638fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:34.930674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725fb5-5951-49c9-b395-64f20e638fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:34.930949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725fb5-5951-49c9-b395-64f20e638fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:34.931253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1725fb5-5951-49c9-b395-64f20e638fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:34.931881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1725fb5-5951-49c9-b395-64f20e638fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:34.933873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1725fb5-5951-49c9-b395-64f20e638fe5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:34.963238 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1214/2456] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:22:34 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:22:34.967329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:34.978050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab226d3-a6d8-4c99-8d40-822cefe10457 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:35.035038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e3fcf-dd2b-43b4-bef9-4c6e58496f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:35.035703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3fcf-dd2b-43b4-bef9-4c6e58496f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.035980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3fcf-dd2b-43b4-bef9-4c6e58496f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.036252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3fcf-dd2b-43b4-bef9-4c6e58496f8f admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.036887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e3fcf-dd2b-43b4-bef9-4c6e58496f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:35.038824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e3fcf-dd2b-43b4-bef9-4c6e58496f8f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:35.059979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1243/2457] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:22:34 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:22:35.064356 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1725fb5-5951-49c9-b395-64f20e638fe5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:35.074562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1725fb5-5951-49c9-b395-64f20e638fe5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:35.080102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054e56-2aeb-41cd-968a-54316fb1fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:35.080694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054e56-2aeb-41cd-968a-54316fb1fb27 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.080978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054e56-2aeb-41cd-968a-54316fb1fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.081287 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f054e56-2aeb-41cd-968a-54316fb1fb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.081927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f054e56-2aeb-41cd-968a-54316fb1fb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:35.083546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f054e56-2aeb-41cd-968a-54316fb1fb27 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:35.093782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1215/2458] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:22:35.097779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e3fcf-dd2b-43b4-bef9-4c6e58496f8f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:35.107686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e3fcf-dd2b-43b4-bef9-4c6e58496f8f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:35.112830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c96c0-99da-4513-8a86-c7645a27add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:35.113481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c96c0-99da-4513-8a86-c7645a27add2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.113765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c96c0-99da-4513-8a86-c7645a27add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.114044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c96c0-99da-4513-8a86-c7645a27add2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.114673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c96c0-99da-4513-8a86-c7645a27add2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:35.116317 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c96c0-99da-4513-8a86-c7645a27add2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:35.127950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1244/2459] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:22:35.132144 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054e56-2aeb-41cd-968a-54316fb1fb27 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:35.142817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f054e56-2aeb-41cd-968a-54316fb1fb27 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:35.147293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:35.147926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.148204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.148478 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] PATH_INFO: `/v3/projects/56b81c11580f4ce385888e2ff17de2ec/users/05fd0d74fb904d0c8828293eda6456c5/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.163832 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] RBAC: Authorizing `identity:create_grant(project_id=56b81c11580f4ce385888e2ff17de2ec, user_id=05fd0d74fb904d0c8828293eda6456c5, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:35.166439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:35.178753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1216/2460] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:22:35 2022] PUT /identity/v3/projects/56b81c11580f4ce385888e2ff17de2ec/users/05fd0d74fb904d0c8828293eda6456c5/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:22:35.189187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d93f8-6bf8-4ef6-bee7-4b08c839798b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.189467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d93f8-6bf8-4ef6-bee7-4b08c839798b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.189744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d93f8-6bf8-4ef6-bee7-4b08c839798b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.217861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-188d93f8-6bf8-4ef6-bee7-4b08c839798b None None] MFA Rules not processed for user `05fd0d74fb904d0c8828293eda6456c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:22:35.219672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-188d93f8-6bf8-4ef6-bee7-4b08c839798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:35.283049 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1245/2461] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:22:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:22:35.294093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:35.295876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:35.306013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:22:35.355168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3f61-59e7-4b2f-a8f7-6fabd21b957b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:35.358783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9e158-3265-4191-97da-b189ef060c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:35.359421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9e158-3265-4191-97da-b189ef060c5b service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.359789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9e158-3265-4191-97da-b189ef060c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.360024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9e158-3265-4191-97da-b189ef060c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.368227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9e158-3265-4191-97da-b189ef060c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:35.369640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9e158-3265-4191-97da-b189ef060c5b service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:35.378691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1217/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:22:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:22:35.404010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d93f8-6bf8-4ef6-bee7-4b08c839798b None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:35.417084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:22:35.470730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d93f8-6bf8-4ef6-bee7-4b08c839798b None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:35.475263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:35.475893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.476166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.476434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] PATH_INFO: `/v3/users/05fd0d74fb904d0c8828293eda6456c5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.477540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fd0d74fb904d0c8828293eda6456c5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:35.479471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:35.526053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fd0d74fb904d0c8828293eda6456c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:35.533764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fd0d74fb904d0c8828293eda6456c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:35.534437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fd0d74fb904d0c8828293eda6456c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:35.535104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fd0d74fb904d0c8828293eda6456c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:35.547072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fd0d74fb904d0c8828293eda6456c5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:35.559768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1246/2463] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:22:35 2022] DELETE /identity/v3/users/05fd0d74fb904d0c8828293eda6456c5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:22:35.564266 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026a643-f495-4b5a-8a6f-b17fe0b9ef58 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.564559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026a643-f495-4b5a-8a6f-b17fe0b9ef58 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.564841 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026a643-f495-4b5a-8a6f-b17fe0b9ef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.583628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0026a643-f495-4b5a-8a6f-b17fe0b9ef58 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:22:35.584835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0026a643-f495-4b5a-8a6f-b17fe0b9ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:35.643559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1218/2464] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:22:35.653091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:35.654490 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:35.711985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeadf6-6e78-431e-9ca2-82f620b301eb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:35.715584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0701cc7-cb50-4cf7-920c-17527cb139dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:35.716184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0701cc7-cb50-4cf7-920c-17527cb139dc service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:35.716463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0701cc7-cb50-4cf7-920c-17527cb139dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:35.716737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0701cc7-cb50-4cf7-920c-17527cb139dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:35.726550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0701cc7-cb50-4cf7-920c-17527cb139dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:35.728033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0701cc7-cb50-4cf7-920c-17527cb139dc service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:35.737527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1247/2465] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:22:36.009699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026a643-f495-4b5a-8a6f-b17fe0b9ef58 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:22:36.011331 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0026a643-f495-4b5a-8a6f-b17fe0b9ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:22:36.025100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026a643-f495-4b5a-8a6f-b17fe0b9ef58 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:22:36.030259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:22:36.031091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:22:36.031373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:22:36.032255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] PATH_INFO: `/v3/projects/56b81c11580f4ce385888e2ff17de2ec` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:22:36.033386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56b81c11580f4ce385888e2ff17de2ec)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:22:36.035295 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:22:36.082776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b81c11580f4ce385888e2ff17de2ec', 'request_id': 'req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:36.088926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b81c11580f4ce385888e2ff17de2ec', 'request_id': 'req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:36.096885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b81c11580f4ce385888e2ff17de2ec', 'request_id': 'req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:36.107404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] The token cache is being invalidate because project 56b81c11580f4ce385888e2ff17de2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:22:36.107698 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:36.108323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:22:36.110539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1219/2466] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:22:36 2022] DELETE /identity/v3/projects/56b81c11580f4ce385888e2ff17de2ec => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:22:45.733279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=74,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:22:46.104337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:25.197546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0701cc7-cb50-4cf7-920c-17527cb139dc service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:25.209489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0701cc7-cb50-4cf7-920c-17527cb139dc service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:25.262599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:25.263227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:25.264113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:25.264460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:25.266227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:25.338792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:25.340266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:25.351955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1248/2467] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:23:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:23:25.494542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:25.496012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:25.508722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9ed0b-b19e-4353-8ea0-ffd246ebc010 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:25.512519 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55fd06-429c-4472-a172-6dd2a7b0f647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:25.513126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55fd06-429c-4472-a172-6dd2a7b0f647 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:25.513406 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55fd06-429c-4472-a172-6dd2a7b0f647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:25.513953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55fd06-429c-4472-a172-6dd2a7b0f647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:25.515680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1a55fd06-429c-4472-a172-6dd2a7b0f647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:25.529673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55fd06-429c-4472-a172-6dd2a7b0f647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:25.531159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55fd06-429c-4472-a172-6dd2a7b0f647 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:25.541933 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1220/2468] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:23:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:23:35.346998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=54 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:35.537082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:35.674493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:35.675982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:35.689997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa59ea-bf7e-4446-840d-1fdbefb0c846 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:35.695410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113c2c3-e50c-46a5-aad3-86a0e9e10284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:35.696005 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c2c3-e50c-46a5-aad3-86a0e9e10284 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:35.696284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c2c3-e50c-46a5-aad3-86a0e9e10284 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:35.696556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113c2c3-e50c-46a5-aad3-86a0e9e10284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:35.698189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b113c2c3-e50c-46a5-aad3-86a0e9e10284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:35.756937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113c2c3-e50c-46a5-aad3-86a0e9e10284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:35.758519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113c2c3-e50c-46a5-aad3-86a0e9e10284 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:35.768989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1249/2469] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:23:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:23:39.458595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3390-52f3-4b33-a0c0-e560a3418684 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:39.459090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3390-52f3-4b33-a0c0-e560a3418684 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:39.459204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3390-52f3-4b33-a0c0-e560a3418684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:39.478743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a29a3390-52f3-4b33-a0c0-e560a3418684 None None] MFA Rules not processed for user `0522e5c104c54f75b249ec924b0b08d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:23:39.479995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a29a3390-52f3-4b33-a0c0-e560a3418684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:39.534674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1221/2470] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:23:45.764315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=28 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:23:48.122835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414826-4ab6-4abc-a674-3b4a05007ae5 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:48.123498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414826-4ab6-4abc-a674-3b4a05007ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:48.123498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414826-4ab6-4abc-a674-3b4a05007ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:48.144073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a5414826-4ab6-4abc-a674-3b4a05007ae5 None None] MFA Rules not processed for user `047780e830d14ab8a1cdb9a6061cb939`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:23:48.145272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a5414826-4ab6-4abc-a674-3b4a05007ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:48.152191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1250/2471] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:23:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:23:48.466501 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3390-52f3-4b33-a0c0-e560a3418684 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:48.478972 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3390-52f3-4b33-a0c0-e560a3418684 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:48.482678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:48.483515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:48.483801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:48.484084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:48.485898 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:48.495955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:48.497389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:48.506349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1222/2472] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:23:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:23:48.884431 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5414826-4ab6-4abc-a674-3b4a05007ae5 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:48.885955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a5414826-4ab6-4abc-a674-3b4a05007ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:48.970628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5414826-4ab6-4abc-a674-3b4a05007ae5 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:48.976154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:48.976768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:48.977045 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:48.977484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:48.979731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:48.996306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:48.997889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:49.011274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1251/2473] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:23:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:23:54.734976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:23:54.737202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:54.748298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d8376-0b09-4f43-9528-dcbd865f82b2 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:23:54.751753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:23:54.752460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:23:54.752852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:23:54.753168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:23:54.755018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:23:54.765612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:23:54.767198 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:23:54.776333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1223/2474] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:23:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:23:59.005362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=35 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:24:04.771920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=37 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:24:39.872740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:39.887267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db61abb-3de4-49c3-a95c-322d5d2cc915 service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:39.896292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:39.896914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:39.897201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:39.897484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:39.901334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:39.925947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:39.928826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:39.941667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1252/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:24:40.553597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:40.556257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:40.625869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456b31b-1f66-4f98-90ce-55db4fc8db29 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:40.629550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:40.630169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:40.630453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:40.630755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:40.632645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:40.693925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:40.695400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:40.705313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1224/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:24:44.832056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:44.844911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3055f00-3552-461a-80e6-71d909e01dcd service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:44.852065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9492b1-8c7d-420f-9a47-987eb4f9afdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:44.853069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9492b1-8c7d-420f-9a47-987eb4f9afdf service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:44.854501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9492b1-8c7d-420f-9a47-987eb4f9afdf service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:44.855598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9492b1-8c7d-420f-9a47-987eb4f9afdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:44.857672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5d9492b1-8c7d-420f-9a47-987eb4f9afdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:44.873486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9492b1-8c7d-420f-9a47-987eb4f9afdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:44.875601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9492b1-8c7d-420f-9a47-987eb4f9afdf service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:44.900101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1253/2477] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:24:50.701505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=48 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:24:50.902618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:50.916471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bc8ed-7093-49f9-b9be-41c4415bdac4 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:50.938564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:50.939754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:50.941419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:50.941911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:50.944179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:50.966251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:50.968120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:50.983004 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1225/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:24:51.002290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c896-3acd-4660-9c81-28d386a75d0f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:51.002739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c896-3acd-4660-9c81-28d386a75d0f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:51.002822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c896-3acd-4660-9c81-28d386a75d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:51.028669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-b405c896-3acd-4660-9c81-28d386a75d0f None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:24:51.030126 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b405c896-3acd-4660-9c81-28d386a75d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:51.096482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1254/2479] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 19:24:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:24:51.150621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:51.152966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:51.226064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1355bd-3458-4ad5-8cc5-129e3791f6af service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:51.231904 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481c6a5-d0b4-4fb6-9ebc-b3d8174f6e96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:51.232524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c6a5-d0b4-4fb6-9ebc-b3d8174f6e96 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:51.232807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c6a5-d0b4-4fb6-9ebc-b3d8174f6e96 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:51.233084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c6a5-d0b4-4fb6-9ebc-b3d8174f6e96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:51.241585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481c6a5-d0b4-4fb6-9ebc-b3d8174f6e96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:51.243201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481c6a5-d0b4-4fb6-9ebc-b3d8174f6e96 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:51.251776 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1226/2480] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:24:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:24:51.625465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c896-3acd-4660-9c81-28d386a75d0f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:51.637397 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c896-3acd-4660-9c81-28d386a75d0f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:51.642689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:51.643680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:51.644151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:51.644638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:51.647313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:51.728389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:51.730584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:51.741332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1255/2481] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:24:52.475440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7df783-b3f2-45a9-8c36-68267c4e529c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:52.475971 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7df783-b3f2-45a9-8c36-68267c4e529c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:52.476071 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7df783-b3f2-45a9-8c36-68267c4e529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:52.495758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ea7df783-b3f2-45a9-8c36-68267c4e529c None None] MFA Rules not processed for user `1e53d46902444c0fb0ab0e56960ff8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:24:52.496988 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ea7df783-b3f2-45a9-8c36-68267c4e529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:52.503964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1227/2482] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:24:54.790044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:54.800630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03d7e-5898-4b6c-a5f8-0ba4aa717b0e service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:54.804372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:54.805499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:54.805780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:54.806054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:54.808591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:54.820380 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:54.821819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:54.831554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1256/2483] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:24:55.757999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7df783-b3f2-45a9-8c36-68267c4e529c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:55.759488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ea7df783-b3f2-45a9-8c36-68267c4e529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:55.775115 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7df783-b3f2-45a9-8c36-68267c4e529c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:55.780129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:55.780741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:55.781021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:55.781294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:55.783145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:55.800626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:55.802483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:55.824844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1228/2484] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:24:58.939652 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:58.957377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5f863-0f8d-4355-b24e-69ff98edf6dd service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:58.962530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:58.963176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:58.964674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:58.965102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:58.967065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:58.984004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:58.985861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:58.996764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1257/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:24:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:24:59.037270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:59.039641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:59.057737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4363f7-4ee5-40bc-8cfd-0a92a72b72e2 service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:59.062450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:59.063113 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:59.063397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:59.063676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] PATH_INFO: `/v3/users/ecafbe3f3e4f4e1d84b7443b9877292c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:59.064798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecafbe3f3e4f4e1d84b7443b9877292c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:59.066742 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:59.130204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecafbe3f3e4f4e1d84b7443b9877292c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.142640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecafbe3f3e4f4e1d84b7443b9877292c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.143431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecafbe3f3e4f4e1d84b7443b9877292c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.149330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecafbe3f3e4f4e1d84b7443b9877292c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.159336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecafbe3f3e4f4e1d84b7443b9877292c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.184865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1229/2486] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:24:59 2022] DELETE /identity/v3/users/ecafbe3f3e4f4e1d84b7443b9877292c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:24:59.432900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:59.448813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24772cc8-7bdb-4af3-b032-5121e631a908 service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:59.495505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:24:59.508552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:59.509182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:59.509466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:59.509743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] PATH_INFO: `/v3/projects/e5230a908cb047108133e82cb76b3e18` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:59.511716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5230a908cb047108133e82cb76b3e18)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:59.513607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:59.560381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5230a908cb047108133e82cb76b3e18', 'request_id': 'req-6ad791d1-1cd8-4984-9166-00a726832382'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.566353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5230a908cb047108133e82cb76b3e18', 'request_id': 'req-6ad791d1-1cd8-4984-9166-00a726832382'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.574871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5230a908cb047108133e82cb76b3e18', 'request_id': 'req-6ad791d1-1cd8-4984-9166-00a726832382'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.586187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] The token cache is being invalidate because project e5230a908cb047108133e82cb76b3e18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:24:59.586492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.587152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.589501 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1258/2487] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:24:59 2022] DELETE /identity/v3/projects/e5230a908cb047108133e82cb76b3e18 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:24:59.593655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:59.595118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:59.608911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460c8b5-c078-47f7-9896-7a2ec622b158 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:24:59.634577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:24:59.668277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:24:59.668908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:24:59.669194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:24:59.669477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] PATH_INFO: `/v3/users/a8871481b29840fbb67fbf7c4e0b9dae` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:24:59.670643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8871481b29840fbb67fbf7c4e0b9dae)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:24:59.672598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:24:59.718800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8871481b29840fbb67fbf7c4e0b9dae'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.726635 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8871481b29840fbb67fbf7c4e0b9dae'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.727405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8871481b29840fbb67fbf7c4e0b9dae'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.728015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8871481b29840fbb67fbf7c4e0b9dae'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.736436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8871481b29840fbb67fbf7c4e0b9dae'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:24:59.753869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1230/2488] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:24:59 2022] DELETE /identity/v3/users/a8871481b29840fbb67fbf7c4e0b9dae => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:24:59.980772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:24:59.982912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:24:59.996918 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad791d1-1cd8-4984-9166-00a726832382 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:00.076668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:00.077438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:00.077787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:00.078135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] PATH_INFO: `/v3/projects/585ad0db5c554d20b209e1b9d23b8250` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:00.079369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=585ad0db5c554d20b209e1b9d23b8250)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:00.081367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:00.129306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585ad0db5c554d20b209e1b9d23b8250', 'request_id': 'req-90838da7-49a6-433e-a2f7-7e959dc2b58e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:00.135414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585ad0db5c554d20b209e1b9d23b8250', 'request_id': 'req-90838da7-49a6-433e-a2f7-7e959dc2b58e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:00.142885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585ad0db5c554d20b209e1b9d23b8250', 'request_id': 'req-90838da7-49a6-433e-a2f7-7e959dc2b58e'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:00.153818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] The token cache is being invalidate because project 585ad0db5c554d20b209e1b9d23b8250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:00.154103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:00.154797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:00.156355 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1259/2489] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:24:59 2022] DELETE /identity/v3/projects/585ad0db5c554d20b209e1b9d23b8250 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:09.750273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:10.150883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:15.524383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:15.527063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:15.589056 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1543c7-cb28-46f0-917e-515b7ddb5a9f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:15.643161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:15.644217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:15.644217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:15.644431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:15.646139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:15.722202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:15.723689 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:15.733890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1231/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:18.985705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:18.987321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:19.004437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838da7-49a6-433e-a2f7-7e959dc2b58e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:19.009365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:19.010309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.010731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.011176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] PATH_INFO: `/v3/users/0522e5c104c54f75b249ec924b0b08d3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.012733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0522e5c104c54f75b249ec924b0b08d3)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:19.014942 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:19.064400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0522e5c104c54f75b249ec924b0b08d3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.072084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0522e5c104c54f75b249ec924b0b08d3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.072697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0522e5c104c54f75b249ec924b0b08d3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.073324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0522e5c104c54f75b249ec924b0b08d3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.085390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-15ab14a5-d785-4dc8-a59e-3bd1ea9f2f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0522e5c104c54f75b249ec924b0b08d3'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.098387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1260/2491] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:18 2022] DELETE /identity/v3/users/0522e5c104c54f75b249ec924b0b08d3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:19.274911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:19.286194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51c060-4545-4ff3-862d-1baffef8ca16 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:19.345512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:19.346145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.346426 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.346720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] PATH_INFO: `/v3/projects/36913be5315d486293e469c928e6e4ec` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.347853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36913be5315d486293e469c928e6e4ec)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:19.349744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:19.357573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:19.397878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36913be5315d486293e469c928e6e4ec', 'request_id': 'req-30ee18c2-2c83-4e2d-9581-1678a3036e79'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.404889 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36913be5315d486293e469c928e6e4ec', 'request_id': 'req-30ee18c2-2c83-4e2d-9581-1678a3036e79'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.412023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36913be5315d486293e469c928e6e4ec', 'request_id': 'req-30ee18c2-2c83-4e2d-9581-1678a3036e79'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.422337 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] The token cache is being invalidate because project 36913be5315d486293e469c928e6e4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:19.422624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.423290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-30ee18c2-2c83-4e2d-9581-1678a3036e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:19.424756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1232/2492] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:19 2022] DELETE /identity/v3/projects/36913be5315d486293e469c928e6e4ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:19.429616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e76132-ac3a-475a-8c12-e89ecaba3430 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.429901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e76132-ac3a-475a-8c12-e89ecaba3430 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.430174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e76132-ac3a-475a-8c12-e89ecaba3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.450700 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-94e76132-ac3a-475a-8c12-e89ecaba3430 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:19.451861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-94e76132-ac3a-475a-8c12-e89ecaba3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:19.510819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1261/2493] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:19.518742 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b919a0-f4d5-4351-8b8b-a5546b748517 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.519049 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b919a0-f4d5-4351-8b8b-a5546b748517 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.519329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b919a0-f4d5-4351-8b8b-a5546b748517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.540668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-17b919a0-f4d5-4351-8b8b-a5546b748517 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:19.541896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-17b919a0-f4d5-4351-8b8b-a5546b748517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:19.549609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1233/2494] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:19.553867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e76132-ac3a-475a-8c12-e89ecaba3430 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:19.563933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e76132-ac3a-475a-8c12-e89ecaba3430 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:19.568465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:19.569065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.569345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.569618 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.570262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:25:19.570566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:19.572179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:19.584511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1262/2495] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:25:19.589570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b919a0-f4d5-4351-8b8b-a5546b748517 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:19.598538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b919a0-f4d5-4351-8b8b-a5546b748517 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:19.603070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b3dc2-182a-4c76-b8e0-f9c4c1ede209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:19.603657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3dc2-182a-4c76-b8e0-f9c4c1ede209 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.604040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3dc2-182a-4c76-b8e0-f9c4c1ede209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.604614 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b3dc2-182a-4c76-b8e0-f9c4c1ede209 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.605193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b3dc2-182a-4c76-b8e0-f9c4c1ede209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:19.607095 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b3dc2-182a-4c76-b8e0-f9c4c1ede209 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:19.634383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1234/2496] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:19 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:19.638673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:19.648626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402041-2aca-4ee1-afac-f528bf328731 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:19.704968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63113-f5f2-46fe-a9bb-55740095d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:19.705524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63113-f5f2-46fe-a9bb-55740095d560 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.705823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63113-f5f2-46fe-a9bb-55740095d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.706081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed63113-f5f2-46fe-a9bb-55740095d560 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.706737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed63113-f5f2-46fe-a9bb-55740095d560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:19.708692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed63113-f5f2-46fe-a9bb-55740095d560 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:19.717463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:19.736279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1263/2497] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:19 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:19.737490 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b3dc2-182a-4c76-b8e0-f9c4c1ede209 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:19.748127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b3dc2-182a-4c76-b8e0-f9c4c1ede209 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:19.753854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206f049-9265-45e4-8afa-e8af60dfe90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:19.754523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f049-9265-45e4-8afa-e8af60dfe90c admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.754808 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f049-9265-45e4-8afa-e8af60dfe90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.755178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206f049-9265-45e4-8afa-e8af60dfe90c admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.755845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206f049-9265-45e4-8afa-e8af60dfe90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:19.757437 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206f049-9265-45e4-8afa-e8af60dfe90c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:19.772197 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1235/2498] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:25:19.773377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63113-f5f2-46fe-a9bb-55740095d560 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:19.784085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed63113-f5f2-46fe-a9bb-55740095d560 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:19.788737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45b04-d6fc-41b4-b128-b058ac9542b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:19.789337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45b04-d6fc-41b4-b128-b058ac9542b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.789616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45b04-d6fc-41b4-b128-b058ac9542b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.789891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45b04-d6fc-41b4-b128-b058ac9542b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.790529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd45b04-d6fc-41b4-b128-b058ac9542b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:19.792768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd45b04-d6fc-41b4-b128-b058ac9542b0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:19.803497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1264/2499] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:19.807719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206f049-9265-45e4-8afa-e8af60dfe90c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:19.817759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206f049-9265-45e4-8afa-e8af60dfe90c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:19.822361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c378a-beb2-4224-bded-a1c227a39998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:19.823068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c378a-beb2-4224-bded-a1c227a39998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.823350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c378a-beb2-4224-bded-a1c227a39998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.823626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c378a-beb2-4224-bded-a1c227a39998 admin admin] PATH_INFO: `/v3/projects/073da135a1a041f0af8e80dc984497a0/users/bd8c5cfc8e744853948196308898f214/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.837826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c378a-beb2-4224-bded-a1c227a39998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073da135a1a041f0af8e80dc984497a0, user_id=bd8c5cfc8e744853948196308898f214, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:19.841385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c378a-beb2-4224-bded-a1c227a39998 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:19.853756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1236/2500] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:19 2022] PUT /identity/v3/projects/073da135a1a041f0af8e80dc984497a0/users/bd8c5cfc8e744853948196308898f214/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:25:19.865750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb729f4-ef37-4390-b28f-45a7a6b95f60 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:19.866036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb729f4-ef37-4390-b28f-45a7a6b95f60 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:19.866312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb729f4-ef37-4390-b28f-45a7a6b95f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:19.895158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-bcb729f4-ef37-4390-b28f-45a7a6b95f60 None None] MFA Rules not processed for user `bd8c5cfc8e744853948196308898f214`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:19.896386 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-bcb729f4-ef37-4390-b28f-45a7a6b95f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:19.968783 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1265/2501] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:19.972969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c378a-beb2-4224-bded-a1c227a39998 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:20.048330 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c378a-beb2-4224-bded-a1c227a39998 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:20.053072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f1ee4-9f03-4932-938a-9257e643ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:20.053717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1ee4-9f03-4932-938a-9257e643ae34 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:20.054011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1ee4-9f03-4932-938a-9257e643ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:20.054277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1ee4-9f03-4932-938a-9257e643ae34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:20.054907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f1ee4-9f03-4932-938a-9257e643ae34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:20.056935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f1ee4-9f03-4932-938a-9257e643ae34 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:20.084438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1237/2502] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:19 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:25:20.088868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb729f4-ef37-4390-b28f-45a7a6b95f60 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:20.101724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb729f4-ef37-4390-b28f-45a7a6b95f60 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:20.163684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad89b1f-0313-4e05-97c5-cf67cf8168dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:20.164400 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad89b1f-0313-4e05-97c5-cf67cf8168dc admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:20.164753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad89b1f-0313-4e05-97c5-cf67cf8168dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:20.165099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad89b1f-0313-4e05-97c5-cf67cf8168dc admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:20.165808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad89b1f-0313-4e05-97c5-cf67cf8168dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:20.168663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad89b1f-0313-4e05-97c5-cf67cf8168dc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:20.191029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1266/2503] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:20 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:25:20.193341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f1ee4-9f03-4932-938a-9257e643ae34 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:20.204862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f1ee4-9f03-4932-938a-9257e643ae34 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:20.209863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59744ee-3fb1-493d-a499-d5bc5b3cda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:20.210472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59744ee-3fb1-493d-a499-d5bc5b3cda91 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:20.210750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59744ee-3fb1-493d-a499-d5bc5b3cda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:20.211185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59744ee-3fb1-493d-a499-d5bc5b3cda91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:20.211834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59744ee-3fb1-493d-a499-d5bc5b3cda91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:20.213918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59744ee-3fb1-493d-a499-d5bc5b3cda91 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:20.225878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1238/2504] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:20.230745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad89b1f-0313-4e05-97c5-cf67cf8168dc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:20.240969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad89b1f-0313-4e05-97c5-cf67cf8168dc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:20.246535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7b1e7-fcd6-4455-a568-113bed54f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:20.247229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7b1e7-fcd6-4455-a568-113bed54f461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:20.247508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7b1e7-fcd6-4455-a568-113bed54f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:20.247784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7b1e7-fcd6-4455-a568-113bed54f461 admin admin] PATH_INFO: `/v3/projects/f4ad6e12056048999ab17a7f984e7c7b/users/8c69dba5e4d746a483d66b5d6d2e53ac/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:20.262938 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7b1e7-fcd6-4455-a568-113bed54f461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ad6e12056048999ab17a7f984e7c7b, user_id=8c69dba5e4d746a483d66b5d6d2e53ac, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:20.265611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7b1e7-fcd6-4455-a568-113bed54f461 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:20.279544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1267/2505] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:20 2022] PUT /identity/v3/projects/f4ad6e12056048999ab17a7f984e7c7b/users/8c69dba5e4d746a483d66b5d6d2e53ac/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:25:20.283767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59744ee-3fb1-493d-a499-d5bc5b3cda91 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:20.295581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59744ee-3fb1-493d-a499-d5bc5b3cda91 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:20.299527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:20.358059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e816e68-b079-41a7-86ec-eca1ae0ce7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:20.358671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e816e68-b079-41a7-86ec-eca1ae0ce7bd admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:20.358955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e816e68-b079-41a7-86ec-eca1ae0ce7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:20.359263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e816e68-b079-41a7-86ec-eca1ae0ce7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:20.359909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e816e68-b079-41a7-86ec-eca1ae0ce7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:20.361490 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e816e68-b079-41a7-86ec-eca1ae0ce7bd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:20.371944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1239/2506] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:20.376087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7b1e7-fcd6-4455-a568-113bed54f461 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:20.387617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7b1e7-fcd6-4455-a568-113bed54f461 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:20.392167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:20.392805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:20.393083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:20.393353 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] PATH_INFO: `/v3/projects/f4ad6e12056048999ab17a7f984e7c7b/users/8c69dba5e4d746a483d66b5d6d2e53ac/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:20.395261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ad6e12056048999ab17a7f984e7c7b, user_id=8c69dba5e4d746a483d66b5d6d2e53ac, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:20.397859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:20.408638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1268/2507] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:20 2022] PUT /identity/v3/projects/f4ad6e12056048999ab17a7f984e7c7b/users/8c69dba5e4d746a483d66b5d6d2e53ac/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:20.419143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271c58e-74fd-4da1-93f3-8a215b535142 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:20.419436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271c58e-74fd-4da1-93f3-8a215b535142 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:20.419743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271c58e-74fd-4da1-93f3-8a215b535142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:20.447600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6271c58e-74fd-4da1-93f3-8a215b535142 None None] MFA Rules not processed for user `8c69dba5e4d746a483d66b5d6d2e53ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:20.448825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6271c58e-74fd-4da1-93f3-8a215b535142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:20.516607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1240/2508] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:20.527891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:20.529584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:20.552355 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:20.587470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8be27-bef1-4c8f-9ca1-fe79307e7b54 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:20.592074 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2781-6f28-4c81-9441-0c5b44a94c57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:20.592668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2781-6f28-4c81-9441-0c5b44a94c57 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:20.592944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2781-6f28-4c81-9441-0c5b44a94c57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:20.593213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b2781-6f28-4c81-9441-0c5b44a94c57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:20.648859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b2781-6f28-4c81-9441-0c5b44a94c57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:20.650292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b2781-6f28-4c81-9441-0c5b44a94c57 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:20.659779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1269/2509] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:23.236674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271c58e-74fd-4da1-93f3-8a215b535142 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:23.246859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271c58e-74fd-4da1-93f3-8a215b535142 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:23.250408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8592a-1bb6-4bca-bcef-ec345c31c4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:23.251030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8592a-1bb6-4bca-bcef-ec345c31c4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:23.251317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8592a-1bb6-4bca-bcef-ec345c31c4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:23.251595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8592a-1bb6-4bca-bcef-ec345c31c4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:23.260513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8592a-1bb6-4bca-bcef-ec345c31c4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:23.261928 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8592a-1bb6-4bca-bcef-ec345c31c4d8 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:23.271274 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1241/2510] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:30.655718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=39 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:33.267054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=66 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:35.839467 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2781-6f28-4c81-9441-0c5b44a94c57 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:35.901886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b2781-6f28-4c81-9441-0c5b44a94c57 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:35.906946 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:35.907596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:35.907877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:35.908176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] PATH_INFO: `/v3/users/bd8c5cfc8e744853948196308898f214` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:35.909285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8c5cfc8e744853948196308898f214)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:35.911258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:35.956910 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8c5cfc8e744853948196308898f214'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:35.964334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8c5cfc8e744853948196308898f214'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:35.964943 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8c5cfc8e744853948196308898f214'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:35.966296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8c5cfc8e744853948196308898f214'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:35.978315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8c5cfc8e744853948196308898f214'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:35.991303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1270/2511] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:35 2022] DELETE /identity/v3/users/bd8c5cfc8e744853948196308898f214 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:35.995848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955bd4-5f39-4e16-9838-1a8674b27547 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:35.996323 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955bd4-5f39-4e16-9838-1a8674b27547 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:35.997084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85955bd4-5f39-4e16-9838-1a8674b27547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:36.015785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-85955bd4-5f39-4e16-9838-1a8674b27547 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:36.016983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-85955bd4-5f39-4e16-9838-1a8674b27547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:36.075859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1242/2512] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:36.085502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:36.086890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:36.144203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91262388-3bf7-47c1-8146-df684930a1c9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:36.147842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa34f-a2a0-4fff-a59a-32af9fac0546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:36.148444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa34f-a2a0-4fff-a59a-32af9fac0546 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:36.148722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa34f-a2a0-4fff-a59a-32af9fac0546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:36.148995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aa34f-a2a0-4fff-a59a-32af9fac0546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:36.158660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aa34f-a2a0-4fff-a59a-32af9fac0546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:36.160118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aa34f-a2a0-4fff-a59a-32af9fac0546 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:36.169607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1271/2513] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:36.439830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85955bd4-5f39-4e16-9838-1a8674b27547 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:36.441278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-85955bd4-5f39-4e16-9838-1a8674b27547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:36.459218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85955bd4-5f39-4e16-9838-1a8674b27547 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:36.464080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:36.464715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:36.464992 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:36.465671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] PATH_INFO: `/v3/projects/073da135a1a041f0af8e80dc984497a0` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:36.467008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073da135a1a041f0af8e80dc984497a0)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:36.468853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:36.515249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073da135a1a041f0af8e80dc984497a0', 'request_id': 'req-01d472da-6cd9-4905-8cfe-803ceb2272c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.521421 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073da135a1a041f0af8e80dc984497a0', 'request_id': 'req-01d472da-6cd9-4905-8cfe-803ceb2272c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.529558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073da135a1a041f0af8e80dc984497a0', 'request_id': 'req-01d472da-6cd9-4905-8cfe-803ceb2272c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.539870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] The token cache is being invalidate because project 073da135a1a041f0af8e80dc984497a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:36.540160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.540775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.542264 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1243/2514] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:36 2022] DELETE /identity/v3/projects/073da135a1a041f0af8e80dc984497a0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:36.546969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa34f-a2a0-4fff-a59a-32af9fac0546 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:36.556566 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aa34f-a2a0-4fff-a59a-32af9fac0546 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:36.574362 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:36.616129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:36.616698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:36.616979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:36.617252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] PATH_INFO: `/v3/users/8c69dba5e4d746a483d66b5d6d2e53ac` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:36.618355 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c69dba5e4d746a483d66b5d6d2e53ac)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:36.620323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:36.670221 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c69dba5e4d746a483d66b5d6d2e53ac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.677261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c69dba5e4d746a483d66b5d6d2e53ac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.678345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c69dba5e4d746a483d66b5d6d2e53ac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.678964 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c69dba5e4d746a483d66b5d6d2e53ac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.691742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-592702e6-a24b-4b98-92d0-7a052ad0f519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c69dba5e4d746a483d66b5d6d2e53ac'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:36.704344 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1272/2515] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:36 2022] DELETE /identity/v3/users/8c69dba5e4d746a483d66b5d6d2e53ac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:37.237583 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:37.239123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:37.252403 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d472da-6cd9-4905-8cfe-803ceb2272c4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:37.310555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:37.311220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.311504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.311780 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] PATH_INFO: `/v3/projects/f4ad6e12056048999ab17a7f984e7c7b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.312895 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ad6e12056048999ab17a7f984e7c7b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:37.314846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:37.355133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:37.373929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ad6e12056048999ab17a7f984e7c7b', 'request_id': 'req-cc59f9ab-4a74-4661-bc6f-a81ada973e53'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:37.380130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ad6e12056048999ab17a7f984e7c7b', 'request_id': 'req-cc59f9ab-4a74-4661-bc6f-a81ada973e53'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:37.387735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ad6e12056048999ab17a7f984e7c7b', 'request_id': 'req-cc59f9ab-4a74-4661-bc6f-a81ada973e53'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:37.398076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] The token cache is being invalidate because project f4ad6e12056048999ab17a7f984e7c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:37.398368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:37.399012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-cc59f9ab-4a74-4661-bc6f-a81ada973e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:37.400498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1244/2516] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:37 2022] DELETE /identity/v3/projects/f4ad6e12056048999ab17a7f984e7c7b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:37.406017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354857-7c7f-419a-8c15-50df6d4022b1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.406509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354857-7c7f-419a-8c15-50df6d4022b1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.406620 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df354857-7c7f-419a-8c15-50df6d4022b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.426550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-df354857-7c7f-419a-8c15-50df6d4022b1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:37.427795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-df354857-7c7f-419a-8c15-50df6d4022b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:37.493268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1273/2517] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:37.501210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26306-7ae0-4a7c-b045-6178b7b8bd81 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.501522 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26306-7ae0-4a7c-b045-6178b7b8bd81 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.501804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae26306-7ae0-4a7c-b045-6178b7b8bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.521383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2ae26306-7ae0-4a7c-b045-6178b7b8bd81 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:37.522603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2ae26306-7ae0-4a7c-b045-6178b7b8bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:37.530968 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1245/2518] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:37.535080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354857-7c7f-419a-8c15-50df6d4022b1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:37.545420 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df354857-7c7f-419a-8c15-50df6d4022b1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:37.549909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:37.550531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.550808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.551121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.551790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:25:37.552088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:37.553664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:37.565437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1274/2519] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:25:37.569578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae26306-7ae0-4a7c-b045-6178b7b8bd81 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:37.579526 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae26306-7ae0-4a7c-b045-6178b7b8bd81 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:37.584147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03323f3b-0533-4813-af1f-2879d2e52b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:37.584738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323f3b-0533-4813-af1f-2879d2e52b59 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.585020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323f3b-0533-4813-af1f-2879d2e52b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.585297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323f3b-0533-4813-af1f-2879d2e52b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.585937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03323f3b-0533-4813-af1f-2879d2e52b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:37.587856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03323f3b-0533-4813-af1f-2879d2e52b59 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:37.618419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1246/2520] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:37 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:37.619664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:37.629503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2631fa-97ad-42e0-a4f5-09f5c7f46b3a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:37.656634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:37.688651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f8ac-cc19-44f3-b6ce-8d5df27f81ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:37.689276 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f8ac-cc19-44f3-b6ce-8d5df27f81ff admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.689559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f8ac-cc19-44f3-b6ce-8d5df27f81ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.689834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9f8ac-cc19-44f3-b6ce-8d5df27f81ff admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.690457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9f8ac-cc19-44f3-b6ce-8d5df27f81ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:37.692473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9f8ac-cc19-44f3-b6ce-8d5df27f81ff admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:37.713922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1275/2521] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:37 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:37.718834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03323f3b-0533-4813-af1f-2879d2e52b59 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:37.729037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03323f3b-0533-4813-af1f-2879d2e52b59 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:37.733829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ac435-396c-475c-a624-e1aa0a79663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:37.734419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ac435-396c-475c-a624-e1aa0a79663f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.734699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ac435-396c-475c-a624-e1aa0a79663f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.734974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ac435-396c-475c-a624-e1aa0a79663f admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.735638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ac435-396c-475c-a624-e1aa0a79663f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:37.737218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ac435-396c-475c-a624-e1aa0a79663f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:37.747077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1247/2522] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:37.750861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f8ac-cc19-44f3-b6ce-8d5df27f81ff admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:37.760580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9f8ac-cc19-44f3-b6ce-8d5df27f81ff admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:37.765774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef2c0c-a1b1-4e16-bc02-939f8aab857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:37.766356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef2c0c-a1b1-4e16-bc02-939f8aab857c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.766631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef2c0c-a1b1-4e16-bc02-939f8aab857c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.766902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef2c0c-a1b1-4e16-bc02-939f8aab857c admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.767563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef2c0c-a1b1-4e16-bc02-939f8aab857c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:37.769157 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef2c0c-a1b1-4e16-bc02-939f8aab857c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:37.780226 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1276/2523] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:37.784348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ac435-396c-475c-a624-e1aa0a79663f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:37.794281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ac435-396c-475c-a624-e1aa0a79663f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:37.798820 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b331c5b-d7bd-4517-a8cc-aeb31cedb350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:37.799497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b331c5b-d7bd-4517-a8cc-aeb31cedb350 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.799779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b331c5b-d7bd-4517-a8cc-aeb31cedb350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.800104 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b331c5b-d7bd-4517-a8cc-aeb31cedb350 admin admin] PATH_INFO: `/v3/projects/a652f3929d654730b943fef98ec28114/users/78a0c00fcb824740ae62a037c1b24913/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.814725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b331c5b-d7bd-4517-a8cc-aeb31cedb350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a652f3929d654730b943fef98ec28114, user_id=78a0c00fcb824740ae62a037c1b24913, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:37.817372 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b331c5b-d7bd-4517-a8cc-aeb31cedb350 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:37.830528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1248/2524] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:37 2022] PUT /identity/v3/projects/a652f3929d654730b943fef98ec28114/users/78a0c00fcb824740ae62a037c1b24913/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:37.842057 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b51b1-361e-4eba-9350-bb3d780d637f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:37.842339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b51b1-361e-4eba-9350-bb3d780d637f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:37.842615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b51b1-361e-4eba-9350-bb3d780d637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:37.870474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-834b51b1-361e-4eba-9350-bb3d780d637f None None] MFA Rules not processed for user `78a0c00fcb824740ae62a037c1b24913`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:37.872405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-834b51b1-361e-4eba-9350-bb3d780d637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:37.938324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1277/2525] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:25:37.942858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b331c5b-d7bd-4517-a8cc-aeb31cedb350 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.006560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b331c5b-d7bd-4517-a8cc-aeb31cedb350 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.011395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffa0ad-76c1-4583-9af4-a3435b2cd504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.012007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffa0ad-76c1-4583-9af4-a3435b2cd504 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.012486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffa0ad-76c1-4583-9af4-a3435b2cd504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.012814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffa0ad-76c1-4583-9af4-a3435b2cd504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.013465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffa0ad-76c1-4583-9af4-a3435b2cd504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.015395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffa0ad-76c1-4583-9af4-a3435b2cd504 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.046492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1249/2526] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:37 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:38.047708 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b51b1-361e-4eba-9350-bb3d780d637f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.058309 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b51b1-361e-4eba-9350-bb3d780d637f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.118793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70aaebb-3444-4f69-b0da-4726493c55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.119814 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aaebb-3444-4f69-b0da-4726493c55ab admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.120274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aaebb-3444-4f69-b0da-4726493c55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.120741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aaebb-3444-4f69-b0da-4726493c55ab admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.121567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70aaebb-3444-4f69-b0da-4726493c55ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.123850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70aaebb-3444-4f69-b0da-4726493c55ab admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.145871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1278/2527] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:38 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:38.149545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffa0ad-76c1-4583-9af4-a3435b2cd504 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.160728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffa0ad-76c1-4583-9af4-a3435b2cd504 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.165503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c10e-8355-4cdd-9e8c-0485fed015e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.166116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c10e-8355-4cdd-9e8c-0485fed015e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.166397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c10e-8355-4cdd-9e8c-0485fed015e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.166672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c10e-8355-4cdd-9e8c-0485fed015e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.167357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c10e-8355-4cdd-9e8c-0485fed015e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.169639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c10e-8355-4cdd-9e8c-0485fed015e4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.181767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1250/2528] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:38.186147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70aaebb-3444-4f69-b0da-4726493c55ab admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.196567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70aaebb-3444-4f69-b0da-4726493c55ab admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.201516 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc855f54-48dc-4ace-9288-2d7c3a45d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.202175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc855f54-48dc-4ace-9288-2d7c3a45d011 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.202462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc855f54-48dc-4ace-9288-2d7c3a45d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.202746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc855f54-48dc-4ace-9288-2d7c3a45d011 admin admin] PATH_INFO: `/v3/projects/3b69196a3a5842dba57cb1eeb158120b/users/116127a2638141cdaf562c4cc122186e/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.218646 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc855f54-48dc-4ace-9288-2d7c3a45d011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b69196a3a5842dba57cb1eeb158120b, user_id=116127a2638141cdaf562c4cc122186e, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.221336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc855f54-48dc-4ace-9288-2d7c3a45d011 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.235886 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1279/2529] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:38 2022] PUT /identity/v3/projects/3b69196a3a5842dba57cb1eeb158120b/users/116127a2638141cdaf562c4cc122186e/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:38.240055 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c10e-8355-4cdd-9e8c-0485fed015e4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.251082 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c10e-8355-4cdd-9e8c-0485fed015e4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.271854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:38.312191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb65d40-0941-4e35-b144-ecab4ddeb283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.312811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb65d40-0941-4e35-b144-ecab4ddeb283 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.313173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb65d40-0941-4e35-b144-ecab4ddeb283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.313365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb65d40-0941-4e35-b144-ecab4ddeb283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.314008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb65d40-0941-4e35-b144-ecab4ddeb283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.315821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb65d40-0941-4e35-b144-ecab4ddeb283 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.326650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1251/2530] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:38.330765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc855f54-48dc-4ace-9288-2d7c3a45d011 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.336359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:38.343709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc855f54-48dc-4ace-9288-2d7c3a45d011 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.348689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.349348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.349632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.349908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] PATH_INFO: `/v3/projects/3b69196a3a5842dba57cb1eeb158120b/users/116127a2638141cdaf562c4cc122186e/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.351864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b69196a3a5842dba57cb1eeb158120b, user_id=116127a2638141cdaf562c4cc122186e, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.354499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.364764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1280/2531] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:38 2022] PUT /identity/v3/projects/3b69196a3a5842dba57cb1eeb158120b/users/116127a2638141cdaf562c4cc122186e/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:38.375363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b180d1e-36f8-4ed7-a075-9c45c18aacd0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.375834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b180d1e-36f8-4ed7-a075-9c45c18aacd0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.376111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b180d1e-36f8-4ed7-a075-9c45c18aacd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.404892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3b180d1e-36f8-4ed7-a075-9c45c18aacd0 None None] MFA Rules not processed for user `116127a2638141cdaf562c4cc122186e`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:38.406120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3b180d1e-36f8-4ed7-a075-9c45c18aacd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:38.475141 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1252/2532] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:38.486465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.488252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:38.545160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac2995-7e7e-4e2a-a157-7d877201c20d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.548809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586c6f5-8069-4f08-8419-31bc51f13759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.549407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c6f5-8069-4f08-8419-31bc51f13759 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.549692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c6f5-8069-4f08-8419-31bc51f13759 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.549969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586c6f5-8069-4f08-8419-31bc51f13759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.558769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c6f5-8069-4f08-8419-31bc51f13759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.560385 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586c6f5-8069-4f08-8419-31bc51f13759 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.569821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1281/2533] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:38.636923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b180d1e-36f8-4ed7-a075-9c45c18aacd0 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.700516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b180d1e-36f8-4ed7-a075-9c45c18aacd0 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.705303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.705986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.706262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.706533 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] PATH_INFO: `/v3/users/78a0c00fcb824740ae62a037c1b24913` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.707674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a0c00fcb824740ae62a037c1b24913)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.709562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.754317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a0c00fcb824740ae62a037c1b24913'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:38.755882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:38.762054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a0c00fcb824740ae62a037c1b24913'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:38.763267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a0c00fcb824740ae62a037c1b24913'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:38.763934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a0c00fcb824740ae62a037c1b24913'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:38.771377 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a0c00fcb824740ae62a037c1b24913'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:38.788422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1253/2534] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:38 2022] DELETE /identity/v3/users/78a0c00fcb824740ae62a037c1b24913 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:38.792889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723be1-f27f-487c-a9e5-1471db1afee4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.793191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723be1-f27f-487c-a9e5-1471db1afee4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.793578 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723be1-f27f-487c-a9e5-1471db1afee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.812896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7f723be1-f27f-487c-a9e5-1471db1afee4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:38.814470 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7f723be1-f27f-487c-a9e5-1471db1afee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:38.873130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1282/2535] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:38.882841 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:38.884254 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:38.941558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbedd16-e80a-413a-87a9-90729eb2f96c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:38.945233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ec729-b452-4ceb-aae1-c94fe3468969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:38.945838 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ec729-b452-4ceb-aae1-c94fe3468969 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:38.946122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ec729-b452-4ceb-aae1-c94fe3468969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:38.946398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ec729-b452-4ceb-aae1-c94fe3468969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:38.956158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ec729-b452-4ceb-aae1-c94fe3468969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:38.957576 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ec729-b452-4ceb-aae1-c94fe3468969 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:38.967262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1254/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:39.312825 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723be1-f27f-487c-a9e5-1471db1afee4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:39.314334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7f723be1-f27f-487c-a9e5-1471db1afee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:39.334135 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723be1-f27f-487c-a9e5-1471db1afee4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:39.341332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:39.341832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:39.342122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:39.342399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] PATH_INFO: `/v3/projects/a652f3929d654730b943fef98ec28114` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:39.343556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a652f3929d654730b943fef98ec28114)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:39.345453 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:39.397867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a652f3929d654730b943fef98ec28114', 'request_id': 'req-f1697cb4-6987-47d9-8b2e-e23641e48afe'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.404568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a652f3929d654730b943fef98ec28114', 'request_id': 'req-f1697cb4-6987-47d9-8b2e-e23641e48afe'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.411830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a652f3929d654730b943fef98ec28114', 'request_id': 'req-f1697cb4-6987-47d9-8b2e-e23641e48afe'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.423080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] The token cache is being invalidate because project a652f3929d654730b943fef98ec28114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:39.423374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.424010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.425483 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1283/2537] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:39 2022] DELETE /identity/v3/projects/a652f3929d654730b943fef98ec28114 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:39.429539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ec729-b452-4ceb-aae1-c94fe3468969 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:39.440981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ec729-b452-4ceb-aae1-c94fe3468969 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:39.505312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:39.505982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:39.506268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:39.506542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] PATH_INFO: `/v3/users/116127a2638141cdaf562c4cc122186e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:39.507686 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=116127a2638141cdaf562c4cc122186e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:39.509610 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:39.558306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116127a2638141cdaf562c4cc122186e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.567046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116127a2638141cdaf562c4cc122186e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.567741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116127a2638141cdaf562c4cc122186e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.568394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116127a2638141cdaf562c4cc122186e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.575982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-3af412e1-5385-4a40-9227-9a274f6f8c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116127a2638141cdaf562c4cc122186e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:39.581420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:39.597893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1255/2538] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:39 2022] DELETE /identity/v3/users/116127a2638141cdaf562c4cc122186e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:39.877190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:39.878668 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:39.897761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1697cb4-6987-47d9-8b2e-e23641e48afe admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:39.911968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:39.961684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:39.962324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:39.962605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:39.962881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] PATH_INFO: `/v3/projects/3b69196a3a5842dba57cb1eeb158120b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:39.964325 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b69196a3a5842dba57cb1eeb158120b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:39.966551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.013660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b69196a3a5842dba57cb1eeb158120b', 'request_id': 'req-0b3c911e-6f90-4069-be61-d4ee2109c9c2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:40.020183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b69196a3a5842dba57cb1eeb158120b', 'request_id': 'req-0b3c911e-6f90-4069-be61-d4ee2109c9c2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:40.030352 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b69196a3a5842dba57cb1eeb158120b', 'request_id': 'req-0b3c911e-6f90-4069-be61-d4ee2109c9c2'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:40.040993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] The token cache is being invalidate because project 3b69196a3a5842dba57cb1eeb158120b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:40.041288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:40.041904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0b3c911e-6f90-4069-be61-d4ee2109c9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:40.044024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1284/2539] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:39 2022] DELETE /identity/v3/projects/3b69196a3a5842dba57cb1eeb158120b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:40.048946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4257bc-ac9d-4058-a140-ec72093c089e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.049236 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4257bc-ac9d-4058-a140-ec72093c089e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.049516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4257bc-ac9d-4058-a140-ec72093c089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.070140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7d4257bc-ac9d-4058-a140-ec72093c089e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:40.071689 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7d4257bc-ac9d-4058-a140-ec72093c089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:40.131554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1256/2540] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:40.139265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f799b20-815b-404d-9889-63a2aa64958e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.139551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f799b20-815b-404d-9889-63a2aa64958e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.139823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f799b20-815b-404d-9889-63a2aa64958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.159326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4f799b20-815b-404d-9889-63a2aa64958e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:40.160529 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4f799b20-815b-404d-9889-63a2aa64958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:40.168897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1285/2541] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:40.173283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4257bc-ac9d-4058-a140-ec72093c089e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.183066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4257bc-ac9d-4058-a140-ec72093c089e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.188609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.189212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.189494 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.189800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.190449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:25:40.190756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.192391 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.203796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1257/2542] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:25:40.207954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f799b20-815b-404d-9889-63a2aa64958e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.218111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f799b20-815b-404d-9889-63a2aa64958e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.222803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391f475-1aba-427e-a1b8-c2a8f2ac73d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.223432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391f475-1aba-427e-a1b8-c2a8f2ac73d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.223714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391f475-1aba-427e-a1b8-c2a8f2ac73d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.223991 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391f475-1aba-427e-a1b8-c2a8f2ac73d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.224635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391f475-1aba-427e-a1b8-c2a8f2ac73d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.226526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391f475-1aba-427e-a1b8-c2a8f2ac73d5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.254152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1286/2543] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:40 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:40.259683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.270408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d0d82-f99a-4447-87c7-673a6037838f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.326903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8ee35-d2a4-44fb-8361-029b219d7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.327538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ee35-d2a4-44fb-8361-029b219d7594 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.327818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ee35-d2a4-44fb-8361-029b219d7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.328093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8ee35-d2a4-44fb-8361-029b219d7594 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.328847 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8ee35-d2a4-44fb-8361-029b219d7594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.330621 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8ee35-d2a4-44fb-8361-029b219d7594 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.352459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1258/2544] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:40 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:40.356588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391f475-1aba-427e-a1b8-c2a8f2ac73d5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.368779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391f475-1aba-427e-a1b8-c2a8f2ac73d5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.374079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83330-efbd-4792-a78d-09887129dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.374684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83330-efbd-4792-a78d-09887129dd89 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.374966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83330-efbd-4792-a78d-09887129dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.375275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b83330-efbd-4792-a78d-09887129dd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.376062 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83330-efbd-4792-a78d-09887129dd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.377649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b83330-efbd-4792-a78d-09887129dd89 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.388731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1287/2545] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:40.392730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8ee35-d2a4-44fb-8361-029b219d7594 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.402941 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8ee35-d2a4-44fb-8361-029b219d7594 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.407873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a20c83-0cf3-4f32-9864-78d0e23129ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.408464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20c83-0cf3-4f32-9864-78d0e23129ca admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.408741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20c83-0cf3-4f32-9864-78d0e23129ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.409015 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a20c83-0cf3-4f32-9864-78d0e23129ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.409832 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a20c83-0cf3-4f32-9864-78d0e23129ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.411389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a20c83-0cf3-4f32-9864-78d0e23129ca admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.423062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1259/2546] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:40.427284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83330-efbd-4792-a78d-09887129dd89 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.438651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b83330-efbd-4792-a78d-09887129dd89 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.443476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5622d7-fcd1-46ce-bce3-51e68c17586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.444137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5622d7-fcd1-46ce-bce3-51e68c17586b admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.444422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5622d7-fcd1-46ce-bce3-51e68c17586b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.444705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5622d7-fcd1-46ce-bce3-51e68c17586b admin admin] PATH_INFO: `/v3/projects/51e82bf838cf4c03bcf6635688ef3edc/users/6005c5b64e1046c2b0dd7ee922d84328/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.460661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5622d7-fcd1-46ce-bce3-51e68c17586b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e82bf838cf4c03bcf6635688ef3edc, user_id=6005c5b64e1046c2b0dd7ee922d84328, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.463608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5622d7-fcd1-46ce-bce3-51e68c17586b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.477154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1288/2547] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:40 2022] PUT /identity/v3/projects/51e82bf838cf4c03bcf6635688ef3edc/users/6005c5b64e1046c2b0dd7ee922d84328/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:40.487358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acff42-a33f-4303-94a9-10fa12eda261 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.487875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acff42-a33f-4303-94a9-10fa12eda261 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.488100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acff42-a33f-4303-94a9-10fa12eda261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.517872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-60acff42-a33f-4303-94a9-10fa12eda261 None None] MFA Rules not processed for user `6005c5b64e1046c2b0dd7ee922d84328`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:40.519155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-60acff42-a33f-4303-94a9-10fa12eda261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:40.560415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:40.585879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1260/2548] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:40.590832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5622d7-fcd1-46ce-bce3-51e68c17586b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.635653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:40.654488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5622d7-fcd1-46ce-bce3-51e68c17586b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.659224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33b0a3-3c15-4869-b647-1e7c03d92a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.659841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b0a3-3c15-4869-b647-1e7c03d92a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.660118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b0a3-3c15-4869-b647-1e7c03d92a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.660393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33b0a3-3c15-4869-b647-1e7c03d92a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.661037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33b0a3-3c15-4869-b647-1e7c03d92a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.662929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33b0a3-3c15-4869-b647-1e7c03d92a1c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.690257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1289/2549] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:40 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:40.694627 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acff42-a33f-4303-94a9-10fa12eda261 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.705685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acff42-a33f-4303-94a9-10fa12eda261 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.760892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831095aa-6dd8-4649-bfbf-7c92f6a2158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.761492 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831095aa-6dd8-4649-bfbf-7c92f6a2158f admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.761774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831095aa-6dd8-4649-bfbf-7c92f6a2158f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.762567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831095aa-6dd8-4649-bfbf-7c92f6a2158f admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.763232 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831095aa-6dd8-4649-bfbf-7c92f6a2158f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.765140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831095aa-6dd8-4649-bfbf-7c92f6a2158f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.787758 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1261/2550] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:40 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:40.791803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33b0a3-3c15-4869-b647-1e7c03d92a1c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.802310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33b0a3-3c15-4869-b647-1e7c03d92a1c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.806849 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ed1f-d1fe-41fc-89ee-30760cbc2bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.807472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ed1f-d1fe-41fc-89ee-30760cbc2bed admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.807752 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ed1f-d1fe-41fc-89ee-30760cbc2bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.808024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ed1f-d1fe-41fc-89ee-30760cbc2bed admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.808664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948ed1f-d1fe-41fc-89ee-30760cbc2bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.810288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948ed1f-d1fe-41fc-89ee-30760cbc2bed admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.820636 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1290/2551] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:40.825332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831095aa-6dd8-4649-bfbf-7c92f6a2158f admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.835254 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831095aa-6dd8-4649-bfbf-7c92f6a2158f admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.840147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edccfa-fa4c-4c9c-b22e-0dbb1d4c9675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.841373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edccfa-fa4c-4c9c-b22e-0dbb1d4c9675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.841656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edccfa-fa4c-4c9c-b22e-0dbb1d4c9675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.841935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edccfa-fa4c-4c9c-b22e-0dbb1d4c9675 admin admin] PATH_INFO: `/v3/projects/8944c571bc7941f2a55bbac61ce0407a/users/4b52bb27f13d4bdeaf473939cf782600/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.856550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edccfa-fa4c-4c9c-b22e-0dbb1d4c9675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8944c571bc7941f2a55bbac61ce0407a, user_id=4b52bb27f13d4bdeaf473939cf782600, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.859216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edccfa-fa4c-4c9c-b22e-0dbb1d4c9675 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.872080 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1262/2552] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:40 2022] PUT /identity/v3/projects/8944c571bc7941f2a55bbac61ce0407a/users/4b52bb27f13d4bdeaf473939cf782600/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:40.875883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ed1f-d1fe-41fc-89ee-30760cbc2bed admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.885690 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ed1f-d1fe-41fc-89ee-30760cbc2bed admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.942634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e6407-eae4-49ba-8a52-c607b6faaff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.943225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e6407-eae4-49ba-8a52-c607b6faaff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.943511 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e6407-eae4-49ba-8a52-c607b6faaff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.943788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e6407-eae4-49ba-8a52-c607b6faaff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.944428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e6407-eae4-49ba-8a52-c607b6faaff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.946008 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e6407-eae4-49ba-8a52-c607b6faaff0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.957747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1291/2553] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:40.961887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edccfa-fa4c-4c9c-b22e-0dbb1d4c9675 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:40.973078 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edccfa-fa4c-4c9c-b22e-0dbb1d4c9675 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:40.977785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:40.978440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:40.978750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:40.979059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] PATH_INFO: `/v3/projects/8944c571bc7941f2a55bbac61ce0407a/users/4b52bb27f13d4bdeaf473939cf782600/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:40.981017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8944c571bc7941f2a55bbac61ce0407a, user_id=4b52bb27f13d4bdeaf473939cf782600, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:40.983788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:40.994059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1263/2554] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:40 2022] PUT /identity/v3/projects/8944c571bc7941f2a55bbac61ce0407a/users/4b52bb27f13d4bdeaf473939cf782600/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:41.004830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2934cc2-a757-4c99-9894-5568733030e3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:41.005123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2934cc2-a757-4c99-9894-5568733030e3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:41.005408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2934cc2-a757-4c99-9894-5568733030e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:41.033351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c2934cc2-a757-4c99-9894-5568733030e3 None None] MFA Rules not processed for user `4b52bb27f13d4bdeaf473939cf782600`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:41.034565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c2934cc2-a757-4c99-9894-5568733030e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:41.102645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1292/2555] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:41.115650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:41.117401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:41.175828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448e1ea-dccf-40ea-bc22-bcf65572333c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:41.179451 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2f02-0f2d-47aa-bd99-5cd3fa73b1ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:41.180077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2f02-0f2d-47aa-bd99-5cd3fa73b1ec service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:41.180358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2f02-0f2d-47aa-bd99-5cd3fa73b1ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:41.180634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f2f02-0f2d-47aa-bd99-5cd3fa73b1ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:41.190093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2f02-0f2d-47aa-bd99-5cd3fa73b1ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:41.191543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f2f02-0f2d-47aa-bd99-5cd3fa73b1ec service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:41.201535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1264/2556] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:41.513207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2934cc2-a757-4c99-9894-5568733030e3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:41.522874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2934cc2-a757-4c99-9894-5568733030e3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:41.527967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b52bb27f13d4bdeaf473939cf782600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8944c571bc7941f2a55bbac61ce0407a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:41.528584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:41.528876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:41.529156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:41.529839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:25:41.530348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:41.533436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:41.546435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1293/2557] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:25:41.550596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2f02-0f2d-47aa-bd99-5cd3fa73b1ec service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:41.565281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f2f02-0f2d-47aa-bd99-5cd3fa73b1ec service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:41.569910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9186-67a7-41af-a773-8a3f42df6c45 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b52bb27f13d4bdeaf473939cf782600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8944c571bc7941f2a55bbac61ce0407a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:41.570525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9186-67a7-41af-a773-8a3f42df6c45 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:41.570810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9186-67a7-41af-a773-8a3f42df6c45 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:41.571116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b9186-67a7-41af-a773-8a3f42df6c45 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:41.571767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b9186-67a7-41af-a773-8a3f42df6c45 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:41.573688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b9186-67a7-41af-a773-8a3f42df6c45 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:41.605189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1265/2558] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:41 2022] POST /identity/v3/projects => generated 353 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:25:41.609542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:41.621342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae93a96-892a-4968-b07b-d6652c726b19 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:41.662874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:41.720257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b52bb27f13d4bdeaf473939cf782600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8944c571bc7941f2a55bbac61ce0407a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:41.721158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:41.721526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:41.721881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:41.722873 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:25:41.723329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:41.725702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:41.739552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1294/2559] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:25:41.776043 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9186-67a7-41af-a773-8a3f42df6c45 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:41.786778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b9186-67a7-41af-a773-8a3f42df6c45 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:41.791418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b52bb27f13d4bdeaf473939cf782600', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8944c571bc7941f2a55bbac61ce0407a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:41.792038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:41.792326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:41.792605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] PATH_INFO: `/v3/projects/af7ea822e6e942909167c42bebc769a1` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:41.794445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af7ea822e6e942909167c42bebc769a1)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:41.796387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:41.808514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:41.844902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7ea822e6e942909167c42bebc769a1', 'request_id': 'req-2b71ec77-c96f-4c2d-8866-81e746980e5f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:41.972309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7ea822e6e942909167c42bebc769a1', 'request_id': 'req-2b71ec77-c96f-4c2d-8866-81e746980e5f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:41.980345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7ea822e6e942909167c42bebc769a1', 'request_id': 'req-2b71ec77-c96f-4c2d-8866-81e746980e5f'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:41.991924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] The token cache is being invalidate because project af7ea822e6e942909167c42bebc769a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:41.992214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:41.992883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-2b71ec77-c96f-4c2d-8866-81e746980e5f tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:41.994400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1266/2560] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:41 2022] DELETE /identity/v3/projects/af7ea822e6e942909167c42bebc769a1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:42.194099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:42.195884 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:42.261776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a663a0-5b8c-4c0a-be2d-3dbc9af7d4f6 tempest-VolumeQuotaClassesTest-46625519 tempest-VolumeQuotaClassesTest-46625519-project-admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:42.317741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:42.318370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:42.318651 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:42.318927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] PATH_INFO: `/v3/users/6005c5b64e1046c2b0dd7ee922d84328` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:42.320094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6005c5b64e1046c2b0dd7ee922d84328)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:42.322037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:42.370701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6005c5b64e1046c2b0dd7ee922d84328'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.377742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6005c5b64e1046c2b0dd7ee922d84328'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.378354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6005c5b64e1046c2b0dd7ee922d84328'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.378974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6005c5b64e1046c2b0dd7ee922d84328'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.389654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:42.392184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6005c5b64e1046c2b0dd7ee922d84328'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.406627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1295/2561] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:42 2022] DELETE /identity/v3/users/6005c5b64e1046c2b0dd7ee922d84328 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:42.411226 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7385-49f8-4bc9-a549-5805ddad76d6 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:42.411510 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7385-49f8-4bc9-a549-5805ddad76d6 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:42.411781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f7385-49f8-4bc9-a549-5805ddad76d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:42.430969 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-3b1f7385-49f8-4bc9-a549-5805ddad76d6 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:42.432221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3b1f7385-49f8-4bc9-a549-5805ddad76d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:42.491012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1267/2562] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:42.501274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:42.502693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:42.560165 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2a5b-7c33-48b5-a804-6f4e70c7e9c1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:42.563777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254ea73-0d47-4692-b27f-53e3342c58d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:42.564378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ea73-0d47-4692-b27f-53e3342c58d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:42.564661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ea73-0d47-4692-b27f-53e3342c58d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:42.564932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254ea73-0d47-4692-b27f-53e3342c58d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:42.573936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254ea73-0d47-4692-b27f-53e3342c58d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:42.575414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254ea73-0d47-4692-b27f-53e3342c58d1 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:42.584672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1296/2563] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:42.858037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f7385-49f8-4bc9-a549-5805ddad76d6 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:42.859556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3b1f7385-49f8-4bc9-a549-5805ddad76d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:42.872386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f7385-49f8-4bc9-a549-5805ddad76d6 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:42.888835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:42.888835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:42.888835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:42.888835 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] PATH_INFO: `/v3/projects/51e82bf838cf4c03bcf6635688ef3edc` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:42.889517 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e82bf838cf4c03bcf6635688ef3edc)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:42.891397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:42.937702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e82bf838cf4c03bcf6635688ef3edc', 'request_id': 'req-f60ef4ba-09bb-4e6c-b147-618eee5517b1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.944235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e82bf838cf4c03bcf6635688ef3edc', 'request_id': 'req-f60ef4ba-09bb-4e6c-b147-618eee5517b1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.952692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e82bf838cf4c03bcf6635688ef3edc', 'request_id': 'req-f60ef4ba-09bb-4e6c-b147-618eee5517b1'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.962814 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] The token cache is being invalidate because project 51e82bf838cf4c03bcf6635688ef3edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:42.963383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.964013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:42.966046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1268/2564] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:42 2022] DELETE /identity/v3/projects/51e82bf838cf4c03bcf6635688ef3edc => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:42.969989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254ea73-0d47-4692-b27f-53e3342c58d1 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:42.979445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254ea73-0d47-4692-b27f-53e3342c58d1 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:43.034667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:43.035318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.035594 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.035863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] PATH_INFO: `/v3/users/4b52bb27f13d4bdeaf473939cf782600` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.036954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b52bb27f13d4bdeaf473939cf782600)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:43.038838 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:43.089921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b52bb27f13d4bdeaf473939cf782600'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.097804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b52bb27f13d4bdeaf473939cf782600'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.098417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b52bb27f13d4bdeaf473939cf782600'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.099050 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b52bb27f13d4bdeaf473939cf782600'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.111129 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ec3884a8-63ce-4716-b72c-6f1e4d7e9e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b52bb27f13d4bdeaf473939cf782600'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.123371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1297/2565] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:42 2022] DELETE /identity/v3/users/4b52bb27f13d4bdeaf473939cf782600 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:43.408727 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:43.410622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:43.443227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ef4ba-09bb-4e6c-b147-618eee5517b1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:43.466077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:43.509729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:43.510465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.510751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.511069 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] PATH_INFO: `/v3/projects/8944c571bc7941f2a55bbac61ce0407a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.512604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8944c571bc7941f2a55bbac61ce0407a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:43.515123 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:43.546525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eacaeb-606a-479d-9502-185326b61efa None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.549095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eacaeb-606a-479d-9502-185326b61efa None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.550462 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eacaeb-606a-479d-9502-185326b61efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.566009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:43.573898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-74eacaeb-606a-479d-9502-185326b61efa None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:43.575486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8944c571bc7941f2a55bbac61ce0407a', 'request_id': 'req-9284c104-3c37-4763-9cf0-8aa2940d83e8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.576424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-74eacaeb-606a-479d-9502-185326b61efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:43.582905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8944c571bc7941f2a55bbac61ce0407a', 'request_id': 'req-9284c104-3c37-4763-9cf0-8aa2940d83e8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.591741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8944c571bc7941f2a55bbac61ce0407a', 'request_id': 'req-9284c104-3c37-4763-9cf0-8aa2940d83e8'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.603531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] The token cache is being invalidate because project 8944c571bc7941f2a55bbac61ce0407a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:43.603857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.604514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-9284c104-3c37-4763-9cf0-8aa2940d83e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:43.606660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1269/2566] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:43 2022] DELETE /identity/v3/projects/8944c571bc7941f2a55bbac61ce0407a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:43.611822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae7c5-ed37-444e-9385-c498ee5d31fb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.612107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae7c5-ed37-444e-9385-c498ee5d31fb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.612379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae7c5-ed37-444e-9385-c498ee5d31fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.632789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-666ae7c5-ed37-444e-9385-c498ee5d31fb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:43.633996 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-666ae7c5-ed37-444e-9385-c498ee5d31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:43.638908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1298/2567] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:25:43.651888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eacaeb-606a-479d-9502-185326b61efa None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:43.653982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-74eacaeb-606a-479d-9502-185326b61efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:43.695307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1270/2568] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:43.704308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640788f5-1873-467e-b096-94e0ae38047f None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.704604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640788f5-1873-467e-b096-94e0ae38047f None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.704885 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640788f5-1873-467e-b096-94e0ae38047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.725223 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-640788f5-1873-467e-b096-94e0ae38047f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:43.726441 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-640788f5-1873-467e-b096-94e0ae38047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:43.729079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eacaeb-606a-479d-9502-185326b61efa None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:43.734319 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887a48d-3f66-4803-b2f5-b1a3e0d94fa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:43.734460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1271/2569] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:25:43.735091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a48d-3f66-4803-b2f5-b1a3e0d94fa9 service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.735448 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a48d-3f66-4803-b2f5-b1a3e0d94fa9 service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.735810 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887a48d-3f66-4803-b2f5-b1a3e0d94fa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.738484 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640788f5-1873-467e-b096-94e0ae38047f None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:43.744612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887a48d-3f66-4803-b2f5-b1a3e0d94fa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:43.746531 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887a48d-3f66-4803-b2f5-b1a3e0d94fa9 service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:43.747582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640788f5-1873-467e-b096-94e0ae38047f None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:43.752162 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:43.752750 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.753031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.753307 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.753948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:25:43.754253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:43.755085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1299/2570] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:25:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 19:25:43.755866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:43.768696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1272/2571] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:25:43.776215 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887a48d-3f66-4803-b2f5-b1a3e0d94fa9 service swift] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:43.791791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887a48d-3f66-4803-b2f5-b1a3e0d94fa9 service swift] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:43.803125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2546-cc99-4967-8f8d-542a32db67a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:43.804033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2546-cc99-4967-8f8d-542a32db67a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.804418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2546-cc99-4967-8f8d-542a32db67a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.804790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa2546-cc99-4967-8f8d-542a32db67a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.805521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa2546-cc99-4967-8f8d-542a32db67a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:43.807554 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa2546-cc99-4967-8f8d-542a32db67a0 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:43.842471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1300/2572] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:43 2022] POST /identity/v3/projects => generated 401 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:43.844087 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:43.854708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dd7ab-20ee-482f-898d-c196e2c237f1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:43.885516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:43.938742 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2b616-8118-4a7f-a29c-94c15cfcfb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:43.939471 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b616-8118-4a7f-a29c-94c15cfcfb10 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.940006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b616-8118-4a7f-a29c-94c15cfcfb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.940006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b616-8118-4a7f-a29c-94c15cfcfb10 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.941042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2b616-8118-4a7f-a29c-94c15cfcfb10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:43.943310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2b616-8118-4a7f-a29c-94c15cfcfb10 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:43.973567 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1273/2573] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:43 2022] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:25:43.977282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2546-cc99-4967-8f8d-542a32db67a0 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:43.989934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa2546-cc99-4967-8f8d-542a32db67a0 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:43.995383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90e8dd-9bf0-48e1-b7f9-b9690c08fca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:43.999040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90e8dd-9bf0-48e1-b7f9-b9690c08fca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:43.999040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90e8dd-9bf0-48e1-b7f9-b9690c08fca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:43.999040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90e8dd-9bf0-48e1-b7f9-b9690c08fca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:43.999040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90e8dd-9bf0-48e1-b7f9-b9690c08fca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.000034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90e8dd-9bf0-48e1-b7f9-b9690c08fca8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.013711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1301/2574] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:44.017345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2b616-8118-4a7f-a29c-94c15cfcfb10 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.037864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2b616-8118-4a7f-a29c-94c15cfcfb10 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.042939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f58b89-0aed-43d5-a000-17dd7672318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.044279 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f58b89-0aed-43d5-a000-17dd7672318e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.044669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f58b89-0aed-43d5-a000-17dd7672318e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.047100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f58b89-0aed-43d5-a000-17dd7672318e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.047100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f58b89-0aed-43d5-a000-17dd7672318e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.047870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f58b89-0aed-43d5-a000-17dd7672318e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.063031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1274/2575] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:44.066970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90e8dd-9bf0-48e1-b7f9-b9690c08fca8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.078626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90e8dd-9bf0-48e1-b7f9-b9690c08fca8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.083844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235538-63d7-47d7-a32c-e1af786ea92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.084647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235538-63d7-47d7-a32c-e1af786ea92d admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.084954 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235538-63d7-47d7-a32c-e1af786ea92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.085222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e235538-63d7-47d7-a32c-e1af786ea92d admin admin] PATH_INFO: `/v3/projects/fd7a3723aeb24339b58dbe5e72d461e9/users/b9e22236874c4420875b405d6d273742/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.119185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e235538-63d7-47d7-a32c-e1af786ea92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7a3723aeb24339b58dbe5e72d461e9, user_id=b9e22236874c4420875b405d6d273742, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.123029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e235538-63d7-47d7-a32c-e1af786ea92d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.140789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1302/2576] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:44 2022] PUT /identity/v3/projects/fd7a3723aeb24339b58dbe5e72d461e9/users/b9e22236874c4420875b405d6d273742/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:44.151294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a674a-f342-4377-ba81-bf01c7bf86cf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.151866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a674a-f342-4377-ba81-bf01c7bf86cf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.152148 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a674a-f342-4377-ba81-bf01c7bf86cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.185439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-052a674a-f342-4377-ba81-bf01c7bf86cf None None] MFA Rules not processed for user `b9e22236874c4420875b405d6d273742`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:44.186562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-052a674a-f342-4377-ba81-bf01c7bf86cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:44.267268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1275/2577] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:44.271889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235538-63d7-47d7-a32c-e1af786ea92d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.326266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:44.345763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e235538-63d7-47d7-a32c-e1af786ea92d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.350792 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be647434-a951-4a11-898c-0b9ddb6c2e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.351457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647434-a951-4a11-898c-0b9ddb6c2e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.351871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647434-a951-4a11-898c-0b9ddb6c2e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.352154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be647434-a951-4a11-898c-0b9ddb6c2e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.352807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be647434-a951-4a11-898c-0b9ddb6c2e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.355020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be647434-a951-4a11-898c-0b9ddb6c2e62 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.391269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1303/2578] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:44 2022] POST /identity/v3/projects => generated 399 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:25:44.392111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a674a-f342-4377-ba81-bf01c7bf86cf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.403751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a674a-f342-4377-ba81-bf01c7bf86cf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.473067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d9f6-3021-444e-a4d6-0dafc1be713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.473848 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d9f6-3021-444e-a4d6-0dafc1be713a admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.474233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d9f6-3021-444e-a4d6-0dafc1be713a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.474609 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335d9f6-3021-444e-a4d6-0dafc1be713a admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.475412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335d9f6-3021-444e-a4d6-0dafc1be713a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.477401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335d9f6-3021-444e-a4d6-0dafc1be713a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.504527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1276/2579] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:44 2022] POST /identity/v3/users => generated 306 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:44.508520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be647434-a951-4a11-898c-0b9ddb6c2e62 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.521993 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be647434-a951-4a11-898c-0b9ddb6c2e62 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.526672 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda12f2f-df63-47a2-8f98-9d19aed42f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.527311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda12f2f-df63-47a2-8f98-9d19aed42f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.528232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda12f2f-df63-47a2-8f98-9d19aed42f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.528509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda12f2f-df63-47a2-8f98-9d19aed42f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.529153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda12f2f-df63-47a2-8f98-9d19aed42f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.530746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda12f2f-df63-47a2-8f98-9d19aed42f8d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.546872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1304/2580] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:44.548165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d9f6-3021-444e-a4d6-0dafc1be713a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.562505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335d9f6-3021-444e-a4d6-0dafc1be713a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.567688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be4958-c89b-4aae-a3e5-3121b608aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.568453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4958-c89b-4aae-a3e5-3121b608aea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.568806 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4958-c89b-4aae-a3e5-3121b608aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.569152 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be4958-c89b-4aae-a3e5-3121b608aea0 admin admin] PATH_INFO: `/v3/projects/7e2fef8dbf8f4a10a0835f39968927b6/users/2cb31881d25d43cf894ec4dc65b71eaf/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.587831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be4958-c89b-4aae-a3e5-3121b608aea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2fef8dbf8f4a10a0835f39968927b6, user_id=2cb31881d25d43cf894ec4dc65b71eaf, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.591938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be4958-c89b-4aae-a3e5-3121b608aea0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.610090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1277/2581] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:44 2022] PUT /identity/v3/projects/7e2fef8dbf8f4a10a0835f39968927b6/users/2cb31881d25d43cf894ec4dc65b71eaf/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:44.614171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda12f2f-df63-47a2-8f98-9d19aed42f8d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.626847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda12f2f-df63-47a2-8f98-9d19aed42f8d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.696180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf1cc-85ad-4e57-9205-ede0385ad4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.696794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf1cc-85ad-4e57-9205-ede0385ad4da admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.697070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf1cc-85ad-4e57-9205-ede0385ad4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.697340 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf1cc-85ad-4e57-9205-ede0385ad4da admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.698002 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cf1cc-85ad-4e57-9205-ede0385ad4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.699726 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cf1cc-85ad-4e57-9205-ede0385ad4da admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.711033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1305/2582] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:44.717035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be4958-c89b-4aae-a3e5-3121b608aea0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.730054 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be4958-c89b-4aae-a3e5-3121b608aea0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.740599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.742007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.742361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.742715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] PATH_INFO: `/v3/projects/7e2fef8dbf8f4a10a0835f39968927b6/users/2cb31881d25d43cf894ec4dc65b71eaf/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.745170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2fef8dbf8f4a10a0835f39968927b6, user_id=2cb31881d25d43cf894ec4dc65b71eaf, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:44.749816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:44.753140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:44.765880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1278/2583] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:44 2022] PUT /identity/v3/projects/7e2fef8dbf8f4a10a0835f39968927b6/users/2cb31881d25d43cf894ec4dc65b71eaf/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:44.776054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20a2cd-c927-4f2e-8148-f989462dee2c None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.776423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20a2cd-c927-4f2e-8148-f989462dee2c None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.776777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20a2cd-c927-4f2e-8148-f989462dee2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:44.810031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fa20a2cd-c927-4f2e-8148-f989462dee2c None None] MFA Rules not processed for user `2cb31881d25d43cf894ec4dc65b71eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:44.811326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fa20a2cd-c927-4f2e-8148-f989462dee2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:44.895606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1306/2584] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:44.906948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:44.908781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:44.987584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f5103-80c9-4d4f-8319-22468f79f24a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:44.991482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929c5fc-73ec-4a1b-935d-174e3e3d0480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:44.992321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c5fc-73ec-4a1b-935d-174e3e3d0480 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:44.992608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c5fc-73ec-4a1b-935d-174e3e3d0480 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:44.993068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929c5fc-73ec-4a1b-935d-174e3e3d0480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:45.006353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c5fc-73ec-4a1b-935d-174e3e3d0480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:45.007925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929c5fc-73ec-4a1b-935d-174e3e3d0480 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:45.019880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1279/2585] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:44 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:45.113390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20a2cd-c927-4f2e-8148-f989462dee2c None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:45.125229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20a2cd-c927-4f2e-8148-f989462dee2c None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:45.129268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c32c4a-ce6f-456d-ba13-95a17af5fe31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:45.131080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c32c4a-ce6f-456d-ba13-95a17af5fe31 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:45.131080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c32c4a-ce6f-456d-ba13-95a17af5fe31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:45.131080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c32c4a-ce6f-456d-ba13-95a17af5fe31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:45.184096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:45.218729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c32c4a-ce6f-456d-ba13-95a17af5fe31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:45.220635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c32c4a-ce6f-456d-ba13-95a17af5fe31 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:45.235288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1307/2586] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:45 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:49.528803 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929c5fc-73ec-4a1b-935d-174e3e3d0480 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:49.605600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929c5fc-73ec-4a1b-935d-174e3e3d0480 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:49.616880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:49.617529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:49.617810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:49.618088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] PATH_INFO: `/v3/users/b9e22236874c4420875b405d6d273742` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:49.619634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e22236874c4420875b405d6d273742)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:49.621947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:49.684995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e22236874c4420875b405d6d273742'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:49.694586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e22236874c4420875b405d6d273742'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:49.695367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e22236874c4420875b405d6d273742'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:49.696259 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e22236874c4420875b405d6d273742'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:49.708738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e22236874c4420875b405d6d273742'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:49.732801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1280/2587] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:49 2022] DELETE /identity/v3/users/b9e22236874c4420875b405d6d273742 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:25:49.737514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b8759-b0d3-45c3-83d8-de0bd2702d17 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:49.737990 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b8759-b0d3-45c3-83d8-de0bd2702d17 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:49.738195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b8759-b0d3-45c3-83d8-de0bd2702d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:49.759114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5e5b8759-b0d3-45c3-83d8-de0bd2702d17 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:49.762019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5e5b8759-b0d3-45c3-83d8-de0bd2702d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:49.835791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1308/2588] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:49.846704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:49.848336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:49.868634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:49.927483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d7f28-02f5-4f63-8791-d14dc346cf20 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:49.935800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc7866-ebab-44da-8751-9ecca074f5ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:49.936444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc7866-ebab-44da-8751-9ecca074f5ba service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:49.936726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc7866-ebab-44da-8751-9ecca074f5ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:49.937003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc7866-ebab-44da-8751-9ecca074f5ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:49.947518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc7866-ebab-44da-8751-9ecca074f5ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:49.949379 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc7866-ebab-44da-8751-9ecca074f5ba service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:49.962582 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1281/2589] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:50.348586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b8759-b0d3-45c3-83d8-de0bd2702d17 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:50.350406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5e5b8759-b0d3-45c3-83d8-de0bd2702d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:50.369527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b8759-b0d3-45c3-83d8-de0bd2702d17 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:50.378948 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:50.380803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:50.381527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:50.381915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] PATH_INFO: `/v3/projects/fd7a3723aeb24339b58dbe5e72d461e9` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:50.383581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7a3723aeb24339b58dbe5e72d461e9)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:50.387748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:50.452755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7a3723aeb24339b58dbe5e72d461e9', 'request_id': 'req-67f9a293-9683-4ff9-b74e-c5aa243b07b5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.459339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7a3723aeb24339b58dbe5e72d461e9', 'request_id': 'req-67f9a293-9683-4ff9-b74e-c5aa243b07b5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.469235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7a3723aeb24339b58dbe5e72d461e9', 'request_id': 'req-67f9a293-9683-4ff9-b74e-c5aa243b07b5'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.481952 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] The token cache is being invalidate because project fd7a3723aeb24339b58dbe5e72d461e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:50.482173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.482841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.484369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1309/2590] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:50 2022] DELETE /identity/v3/projects/fd7a3723aeb24339b58dbe5e72d461e9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:50.488288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc7866-ebab-44da-8751-9ecca074f5ba service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:50.499656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc7866-ebab-44da-8751-9ecca074f5ba service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:50.573409 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:50.574569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:50.574569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:50.574965 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] PATH_INFO: `/v3/users/2cb31881d25d43cf894ec4dc65b71eaf` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:50.576369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb31881d25d43cf894ec4dc65b71eaf)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:50.578393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:50.640845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb31881d25d43cf894ec4dc65b71eaf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.652674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb31881d25d43cf894ec4dc65b71eaf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.653663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb31881d25d43cf894ec4dc65b71eaf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.654603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb31881d25d43cf894ec4dc65b71eaf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.663587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d730fe6-11c3-41a5-b42b-687c7e239d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb31881d25d43cf894ec4dc65b71eaf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:50.685527 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1282/2591] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:50 2022] DELETE /identity/v3/users/2cb31881d25d43cf894ec4dc65b71eaf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:51.000211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:51.001702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:51.021747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9a293-9683-4ff9-b74e-c5aa243b07b5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:51.101890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:51.102829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.103311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.103761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] PATH_INFO: `/v3/projects/7e2fef8dbf8f4a10a0835f39968927b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.107494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2fef8dbf8f4a10a0835f39968927b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:51.111469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:51.115763 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:51.174262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2fef8dbf8f4a10a0835f39968927b6', 'request_id': 'req-7e343613-2f00-4ba2-b824-27dcc8355fd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:51.180902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2fef8dbf8f4a10a0835f39968927b6', 'request_id': 'req-7e343613-2f00-4ba2-b824-27dcc8355fd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:51.191130 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2fef8dbf8f4a10a0835f39968927b6', 'request_id': 'req-7e343613-2f00-4ba2-b824-27dcc8355fd8'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:51.203673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] The token cache is being invalidate because project 7e2fef8dbf8f4a10a0835f39968927b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:51.203974 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:51.205248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-7e343613-2f00-4ba2-b824-27dcc8355fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:51.206924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1310/2592] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:50 2022] DELETE /identity/v3/projects/7e2fef8dbf8f4a10a0835f39968927b6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:51.211905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094999-bdfe-448e-a067-28822b6b2d74 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.212182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094999-bdfe-448e-a067-28822b6b2d74 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.212463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094999-bdfe-448e-a067-28822b6b2d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.233764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-67094999-bdfe-448e-a067-28822b6b2d74 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:51.247851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-67094999-bdfe-448e-a067-28822b6b2d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:51.311456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:51.358643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1283/2593] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:51.366085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90dd0e-43d6-4808-b377-4a9959606224 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.366373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90dd0e-43d6-4808-b377-4a9959606224 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.366795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90dd0e-43d6-4808-b377-4a9959606224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.393848 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-6b90dd0e-43d6-4808-b377-4a9959606224 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:51.397826 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-6b90dd0e-43d6-4808-b377-4a9959606224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:51.410715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1311/2594] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:51.411735 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67094999-bdfe-448e-a067-28822b6b2d74 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:51.426072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67094999-bdfe-448e-a067-28822b6b2d74 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:51.451730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:51.452460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.452842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.453222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.453996 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:25:51.455288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:51.457101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:51.472336 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1284/2595] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:25:51.476738 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90dd0e-43d6-4808-b377-4a9959606224 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:51.487378 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90dd0e-43d6-4808-b377-4a9959606224 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:51.492410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff737069-00fe-47d5-93d9-307643c52532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:51.493027 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff737069-00fe-47d5-93d9-307643c52532 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.493310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff737069-00fe-47d5-93d9-307643c52532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.493584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff737069-00fe-47d5-93d9-307643c52532 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.494223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff737069-00fe-47d5-93d9-307643c52532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:51.496265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff737069-00fe-47d5-93d9-307643c52532 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:51.530510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1312/2596] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:51 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:25:51.535324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:51.547464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d19b0-1a9d-4527-adfb-8919e2eadbc3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:51.624668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d28a80-149b-42fd-aa12-c66520465db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:51.626134 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d28a80-149b-42fd-aa12-c66520465db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.626574 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d28a80-149b-42fd-aa12-c66520465db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.627052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d28a80-149b-42fd-aa12-c66520465db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.627696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d28a80-149b-42fd-aa12-c66520465db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:51.629599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d28a80-149b-42fd-aa12-c66520465db6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:51.657920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1285/2597] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:51 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:25:51.659965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff737069-00fe-47d5-93d9-307643c52532 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:51.672583 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff737069-00fe-47d5-93d9-307643c52532 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:51.678097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7624141-ec8b-4765-a7ac-46fb08502ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:51.678973 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7624141-ec8b-4765-a7ac-46fb08502ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.679316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7624141-ec8b-4765-a7ac-46fb08502ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.679644 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7624141-ec8b-4765-a7ac-46fb08502ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.680302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7624141-ec8b-4765-a7ac-46fb08502ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:51.681925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7624141-ec8b-4765-a7ac-46fb08502ff2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:51.693776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1313/2598] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:51.698058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d28a80-149b-42fd-aa12-c66520465db6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:51.709528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d28a80-149b-42fd-aa12-c66520465db6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:51.724177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80da0e4-b4c2-4df5-b628-20bfb719c7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:51.725332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da0e4-b4c2-4df5-b628-20bfb719c7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.725836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da0e4-b4c2-4df5-b628-20bfb719c7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.726204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80da0e4-b4c2-4df5-b628-20bfb719c7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.727140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80da0e4-b4c2-4df5-b628-20bfb719c7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:51.729844 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80da0e4-b4c2-4df5-b628-20bfb719c7f1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:51.742857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1286/2599] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:51.747673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7624141-ec8b-4765-a7ac-46fb08502ff2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:51.758075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7624141-ec8b-4765-a7ac-46fb08502ff2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:51.763367 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f882a4f-921d-451e-9e33-594ef5ea0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:51.764141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882a4f-921d-451e-9e33-594ef5ea0c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.764482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882a4f-921d-451e-9e33-594ef5ea0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.764821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f882a4f-921d-451e-9e33-594ef5ea0c03 admin admin] PATH_INFO: `/v3/projects/886627e29bdb4115b01dea30691b9247/users/d6fdd40e88244824ab818e7278a8f99d/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.783619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f882a4f-921d-451e-9e33-594ef5ea0c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=886627e29bdb4115b01dea30691b9247, user_id=d6fdd40e88244824ab818e7278a8f99d, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:51.786399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f882a4f-921d-451e-9e33-594ef5ea0c03 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:51.811263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1314/2600] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:51 2022] PUT /identity/v3/projects/886627e29bdb4115b01dea30691b9247/users/d6fdd40e88244824ab818e7278a8f99d/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:51.812771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3468-30c5-4146-8eda-473da9bd723e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:51.813137 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3468-30c5-4146-8eda-473da9bd723e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:51.813489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd3468-30c5-4146-8eda-473da9bd723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:51.846654 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-41fd3468-30c5-4146-8eda-473da9bd723e None None] MFA Rules not processed for user `d6fdd40e88244824ab818e7278a8f99d`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:51.848290 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-41fd3468-30c5-4146-8eda-473da9bd723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:51.925122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1287/2601] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:51.929664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f882a4f-921d-451e-9e33-594ef5ea0c03 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:52.003313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f882a4f-921d-451e-9e33-594ef5ea0c03 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:52.010664 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ff0cd-acb9-4a9f-b8a9-546b9ff1be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:52.011819 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff0cd-acb9-4a9f-b8a9-546b9ff1be11 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.012107 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff0cd-acb9-4a9f-b8a9-546b9ff1be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.012382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ff0cd-acb9-4a9f-b8a9-546b9ff1be11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.013035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ff0cd-acb9-4a9f-b8a9-546b9ff1be11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:52.014944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ff0cd-acb9-4a9f-b8a9-546b9ff1be11 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:52.047458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1315/2602] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:51 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:25:52.048639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3468-30c5-4146-8eda-473da9bd723e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:52.060670 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd3468-30c5-4146-8eda-473da9bd723e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:52.095128 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:52.127500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db872e-7378-428a-8449-555b9a74a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:52.128321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db872e-7378-428a-8449-555b9a74a05e admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.128763 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db872e-7378-428a-8449-555b9a74a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.129103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db872e-7378-428a-8449-555b9a74a05e admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.129938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db872e-7378-428a-8449-555b9a74a05e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:52.131961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db872e-7378-428a-8449-555b9a74a05e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:52.156412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1288/2603] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:52 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:52.160046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ff0cd-acb9-4a9f-b8a9-546b9ff1be11 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:52.170980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ff0cd-acb9-4a9f-b8a9-546b9ff1be11 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:52.177541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f55ce-238e-4f7c-86e5-5a10d1e0aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:52.178305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f55ce-238e-4f7c-86e5-5a10d1e0aeca admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.178563 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f55ce-238e-4f7c-86e5-5a10d1e0aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.179064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f55ce-238e-4f7c-86e5-5a10d1e0aeca admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.179771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f55ce-238e-4f7c-86e5-5a10d1e0aeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:52.181296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f55ce-238e-4f7c-86e5-5a10d1e0aeca admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:52.193530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1316/2604] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:52.198612 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db872e-7378-428a-8449-555b9a74a05e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:52.212292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db872e-7378-428a-8449-555b9a74a05e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:52.217509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd24dbd-4296-4b38-af7c-23a316a28e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:52.218170 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd24dbd-4296-4b38-af7c-23a316a28e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.218456 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd24dbd-4296-4b38-af7c-23a316a28e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.218731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd24dbd-4296-4b38-af7c-23a316a28e7d admin admin] PATH_INFO: `/v3/projects/b72d5356a0574ece94d1c4ef86700449/users/a7959d1e777b4c57a8b94e8be5da77bb/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.237563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd24dbd-4296-4b38-af7c-23a316a28e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72d5356a0574ece94d1c4ef86700449, user_id=a7959d1e777b4c57a8b94e8be5da77bb, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:52.240343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd24dbd-4296-4b38-af7c-23a316a28e7d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:52.258761 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1289/2605] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:52 2022] PUT /identity/v3/projects/b72d5356a0574ece94d1c4ef86700449/users/a7959d1e777b4c57a8b94e8be5da77bb/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:52.260014 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f55ce-238e-4f7c-86e5-5a10d1e0aeca admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:52.265510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:52.274381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f55ce-238e-4f7c-86e5-5a10d1e0aeca admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:52.340316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e976cdf-7ce9-46f1-96fb-c6a15f59a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:52.340929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976cdf-7ce9-46f1-96fb-c6a15f59a5de admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.341209 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976cdf-7ce9-46f1-96fb-c6a15f59a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.341482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976cdf-7ce9-46f1-96fb-c6a15f59a5de admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.342122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e976cdf-7ce9-46f1-96fb-c6a15f59a5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:52.343779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e976cdf-7ce9-46f1-96fb-c6a15f59a5de admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:52.358347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1317/2606] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:25:52.359572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd24dbd-4296-4b38-af7c-23a316a28e7d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:52.369986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd24dbd-4296-4b38-af7c-23a316a28e7d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:52.375317 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:52.376077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.376364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.376641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] PATH_INFO: `/v3/projects/b72d5356a0574ece94d1c4ef86700449/users/a7959d1e777b4c57a8b94e8be5da77bb/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.378561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72d5356a0574ece94d1c4ef86700449, user_id=a7959d1e777b4c57a8b94e8be5da77bb, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:52.381192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:52.393010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1290/2607] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:52 2022] PUT /identity/v3/projects/b72d5356a0574ece94d1c4ef86700449/users/a7959d1e777b4c57a8b94e8be5da77bb/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:52.461669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d837d-db6e-4373-9305-9c275f7f47c9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.462188 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d837d-db6e-4373-9305-9c275f7f47c9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.462365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d837d-db6e-4373-9305-9c275f7f47c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.494166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e72d837d-db6e-4373-9305-9c275f7f47c9 None None] MFA Rules not processed for user `a7959d1e777b4c57a8b94e8be5da77bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:52.496293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e72d837d-db6e-4373-9305-9c275f7f47c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:52.577227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1318/2608] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:25:52.590496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:52.592668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:52.659430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1063b-393a-4b4d-9ca4-31761fc7b199 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:52.663092 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b188c72-39f8-43a5-9be3-58fe853056c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:52.663709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188c72-39f8-43a5-9be3-58fe853056c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.663986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188c72-39f8-43a5-9be3-58fe853056c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.664262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188c72-39f8-43a5-9be3-58fe853056c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.679132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b188c72-39f8-43a5-9be3-58fe853056c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:52.680867 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b188c72-39f8-43a5-9be3-58fe853056c2 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:52.691630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1291/2609] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:52.779939 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d837d-db6e-4373-9305-9c275f7f47c9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:52.789786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d837d-db6e-4373-9305-9c275f7f47c9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:52.794264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1db9f-6ca8-4480-b2ab-24060a9f0772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:52.794902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1db9f-6ca8-4480-b2ab-24060a9f0772 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:52.795212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1db9f-6ca8-4480-b2ab-24060a9f0772 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:52.795515 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1db9f-6ca8-4480-b2ab-24060a9f0772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:52.863960 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1db9f-6ca8-4480-b2ab-24060a9f0772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:52.865614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1db9f-6ca8-4480-b2ab-24060a9f0772 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:52.875989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1319/2610] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:57.692158 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b188c72-39f8-43a5-9be3-58fe853056c2 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:57.754235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b188c72-39f8-43a5-9be3-58fe853056c2 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:57.758660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:57.759314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:57.759595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:57.759862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] PATH_INFO: `/v3/users/d6fdd40e88244824ab818e7278a8f99d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:57.760956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fdd40e88244824ab818e7278a8f99d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:57.763459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:57.795544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:57.811110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fdd40e88244824ab818e7278a8f99d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:57.819127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fdd40e88244824ab818e7278a8f99d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:57.819784 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fdd40e88244824ab818e7278a8f99d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:57.820390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fdd40e88244824ab818e7278a8f99d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:57.828042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fdd40e88244824ab818e7278a8f99d'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:57.845120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1292/2611] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:57 2022] DELETE /identity/v3/users/d6fdd40e88244824ab818e7278a8f99d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:57.849601 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dac75-9493-4b51-8d0e-b129aa1d9e16 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:57.850081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dac75-9493-4b51-8d0e-b129aa1d9e16 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:57.850180 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dac75-9493-4b51-8d0e-b129aa1d9e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:57.869573 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e20dac75-9493-4b51-8d0e-b129aa1d9e16 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:57.871677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e20dac75-9493-4b51-8d0e-b129aa1d9e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:57.888101 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:57.931018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1320/2612] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:57.941657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:57.943200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:58.015406 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468ab48-1dc9-4e56-b87d-d94617ef1628 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:58.019278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ab0ab-6bb5-4f8e-b1d7-14cb9b6c7ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:58.019887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab0ab-6bb5-4f8e-b1d7-14cb9b6c7ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:58.020167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab0ab-6bb5-4f8e-b1d7-14cb9b6c7ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:58.020441 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ab0ab-6bb5-4f8e-b1d7-14cb9b6c7ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:58.029863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ab0ab-6bb5-4f8e-b1d7-14cb9b6c7ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:58.031326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ab0ab-6bb5-4f8e-b1d7-14cb9b6c7ec6 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:58.040794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1293/2613] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:25:58.313957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dac75-9493-4b51-8d0e-b129aa1d9e16 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:58.315460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e20dac75-9493-4b51-8d0e-b129aa1d9e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:58.328266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dac75-9493-4b51-8d0e-b129aa1d9e16 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:58.333044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:58.333683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:58.333959 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:58.334232 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] PATH_INFO: `/v3/projects/886627e29bdb4115b01dea30691b9247` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:58.335370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=886627e29bdb4115b01dea30691b9247)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:58.337360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:58.383970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886627e29bdb4115b01dea30691b9247', 'request_id': 'req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.390551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886627e29bdb4115b01dea30691b9247', 'request_id': 'req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.397441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886627e29bdb4115b01dea30691b9247', 'request_id': 'req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.408364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] The token cache is being invalidate because project 886627e29bdb4115b01dea30691b9247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:58.408649 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.409265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.410722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1321/2614] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:58 2022] DELETE /identity/v3/projects/886627e29bdb4115b01dea30691b9247 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:58.414644 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ab0ab-6bb5-4f8e-b1d7-14cb9b6c7ec6 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:58.425088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ab0ab-6bb5-4f8e-b1d7-14cb9b6c7ec6 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:58.490319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:58.490952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:58.491262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:58.491538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] PATH_INFO: `/v3/users/a7959d1e777b4c57a8b94e8be5da77bb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:58.492653 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7959d1e777b4c57a8b94e8be5da77bb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:58.494603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:58.542032 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7959d1e777b4c57a8b94e8be5da77bb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.546001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:58.550842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7959d1e777b4c57a8b94e8be5da77bb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.552040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7959d1e777b4c57a8b94e8be5da77bb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.552801 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7959d1e777b4c57a8b94e8be5da77bb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.561021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-c22eb7d9-f407-4b14-9d19-98a6e918142e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7959d1e777b4c57a8b94e8be5da77bb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:58.578957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1294/2615] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:25:58 2022] DELETE /identity/v3/users/a7959d1e777b4c57a8b94e8be5da77bb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:58.861747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:58.861747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:58.880877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e96f-8cd7-42e0-9ef6-08b6c49e1ca7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:58.945944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:58.946581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:58.946917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:58.947223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] PATH_INFO: `/v3/projects/b72d5356a0574ece94d1c4ef86700449` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:58.948357 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72d5356a0574ece94d1c4ef86700449)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:58.950258 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:58.997452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:58.999075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72d5356a0574ece94d1c4ef86700449', 'request_id': 'req-b650a25c-59b8-457f-9256-d05b6f9b2b6d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:59.007985 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72d5356a0574ece94d1c4ef86700449', 'request_id': 'req-b650a25c-59b8-457f-9256-d05b6f9b2b6d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:59.017303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72d5356a0574ece94d1c4ef86700449', 'request_id': 'req-b650a25c-59b8-457f-9256-d05b6f9b2b6d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:59.030686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] The token cache is being invalidate because project b72d5356a0574ece94d1c4ef86700449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:25:59.031108 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:59.031794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-b650a25c-59b8-457f-9256-d05b6f9b2b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:25:59.033277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1322/2616] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:25:58 2022] DELETE /identity/v3/projects/b72d5356a0574ece94d1c4ef86700449 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:25:59.039303 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe88ff-55f9-42cf-b2bc-ae89becdc4b5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.039775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe88ff-55f9-42cf-b2bc-ae89becdc4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.039877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe88ff-55f9-42cf-b2bc-ae89becdc4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.061064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-00fe88ff-55f9-42cf-b2bc-ae89becdc4b5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:59.062288 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-00fe88ff-55f9-42cf-b2bc-ae89becdc4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:59.123666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1295/2617] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:59.131343 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbd6f-db8b-4bd5-8bbb-7846e067a20a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.131665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbd6f-db8b-4bd5-8bbb-7846e067a20a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.131929 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcbd6f-db8b-4bd5-8bbb-7846e067a20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.152978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-67dcbd6f-db8b-4bd5-8bbb-7846e067a20a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:59.154189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-67dcbd6f-db8b-4bd5-8bbb-7846e067a20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:59.162127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1323/2618] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:59.166444 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe88ff-55f9-42cf-b2bc-ae89becdc4b5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:59.176310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe88ff-55f9-42cf-b2bc-ae89becdc4b5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:59.181117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:59.181722 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.182006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.182285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.183630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:25:59.183948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:59.185604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:59.198102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1296/2619] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:25:59.203733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcbd6f-db8b-4bd5-8bbb-7846e067a20a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:59.213823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcbd6f-db8b-4bd5-8bbb-7846e067a20a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:59.218980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914a8b-dba8-4dee-add1-1858f2759fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:59.219611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914a8b-dba8-4dee-add1-1858f2759fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.219893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914a8b-dba8-4dee-add1-1858f2759fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.220169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39914a8b-dba8-4dee-add1-1858f2759fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.220822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914a8b-dba8-4dee-add1-1858f2759fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:59.222900 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39914a8b-dba8-4dee-add1-1858f2759fc7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:59.251299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1324/2620] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:25:59 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:59.255294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:59.265946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87172529-e7d2-46c3-8062-55997c989775 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:59.325114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71569a-a6e4-4149-b89c-0d87b7f549bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:59.325764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71569a-a6e4-4149-b89c-0d87b7f549bf admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.326045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71569a-a6e4-4149-b89c-0d87b7f549bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.326321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71569a-a6e4-4149-b89c-0d87b7f549bf admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.327027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71569a-a6e4-4149-b89c-0d87b7f549bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:59.328961 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71569a-a6e4-4149-b89c-0d87b7f549bf admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:59.354142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1297/2621] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:25:59 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:25:59.356081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914a8b-dba8-4dee-add1-1858f2759fc7 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:59.366369 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39914a8b-dba8-4dee-add1-1858f2759fc7 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:59.372233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa01de6-74db-44a5-b4ed-cfd87699da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:59.372780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa01de6-74db-44a5-b4ed-cfd87699da3c admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.373174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa01de6-74db-44a5-b4ed-cfd87699da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.373460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa01de6-74db-44a5-b4ed-cfd87699da3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.374105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa01de6-74db-44a5-b4ed-cfd87699da3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:59.375779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa01de6-74db-44a5-b4ed-cfd87699da3c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:59.389393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1325/2622] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:25:59.390765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71569a-a6e4-4149-b89c-0d87b7f549bf admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:59.401167 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71569a-a6e4-4149-b89c-0d87b7f549bf admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:59.406241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c57dc-686f-4488-bb0e-6b6741fe06bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:59.406840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c57dc-686f-4488-bb0e-6b6741fe06bd admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.407181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c57dc-686f-4488-bb0e-6b6741fe06bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.407454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c57dc-686f-4488-bb0e-6b6741fe06bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.408089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c57dc-686f-4488-bb0e-6b6741fe06bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:59.409643 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c57dc-686f-4488-bb0e-6b6741fe06bd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:59.421702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1298/2623] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:25:59.425888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa01de6-74db-44a5-b4ed-cfd87699da3c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:59.436693 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa01de6-74db-44a5-b4ed-cfd87699da3c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:59.441536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:59.442216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.442474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.442754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] PATH_INFO: `/v3/projects/e68ddd83d26040e08138d028e505fa1e/users/21eab040d6fc4fd29744acb20fb84505/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.457984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68ddd83d26040e08138d028e505fa1e, user_id=21eab040d6fc4fd29744acb20fb84505, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:59.460841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:59.475053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1326/2624] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:25:59 2022] PUT /identity/v3/projects/e68ddd83d26040e08138d028e505fa1e/users/21eab040d6fc4fd29744acb20fb84505/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:25:59.486397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7d84-bdbb-4fb9-a0bc-e3cf0a4437e3 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.486675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7d84-bdbb-4fb9-a0bc-e3cf0a4437e3 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.486947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb7d84-bdbb-4fb9-a0bc-e3cf0a4437e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.515862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f8fb7d84-bdbb-4fb9-a0bc-e3cf0a4437e3 None None] MFA Rules not processed for user `21eab040d6fc4fd29744acb20fb84505`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:25:59.517074 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f8fb7d84-bdbb-4fb9-a0bc-e3cf0a4437e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:59.544896 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:25:59.600532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1299/2625] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:25:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:25:59.612597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:25:59.614195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:25:59.680071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a60ede-3de8-4cb1-b6a3-da7af1f9d1eb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:25:59.684296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:25:59.685079 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:25:59.685370 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:25:59.685712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:25:59.695989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:25:59.696697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:25:59.707580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1327/2626] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:25:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:01.567568 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5d53-7cc6-46d2-be14-4b808230c996 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:01.568072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5d53-7cc6-46d2-be14-4b808230c996 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:01.568072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5d53-7cc6-46d2-be14-4b808230c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:01.587709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-01eb5d53-7cc6-46d2-be14-4b808230c996 None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:01.588966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-01eb5d53-7cc6-46d2-be14-4b808230c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:01.642938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1300/2627] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:26:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:01.654812 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:01.656216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:01.730117 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8597a5a-73ed-4d29-9e78-beaadf6d5e1e service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:01.735125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3d234-b2df-4a3e-9ca0-d2e8def49cac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:01.735742 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d234-b2df-4a3e-9ca0-d2e8def49cac service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:01.736012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d234-b2df-4a3e-9ca0-d2e8def49cac service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:01.736282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d234-b2df-4a3e-9ca0-d2e8def49cac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:01.744916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3d234-b2df-4a3e-9ca0-d2e8def49cac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:01.747449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3d234-b2df-4a3e-9ca0-d2e8def49cac service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:01.755913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1328/2628] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:26:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:26:09.992924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb5d53-7cc6-46d2-be14-4b808230c996 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:10.057795 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb5d53-7cc6-46d2-be14-4b808230c996 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:10.063246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:10.063882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:10.064166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:10.064463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] PATH_INFO: `/v3/users/21eab040d6fc4fd29744acb20fb84505` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:10.065581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21eab040d6fc4fd29744acb20fb84505)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:10.067532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:10.134398 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21eab040d6fc4fd29744acb20fb84505'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.142656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21eab040d6fc4fd29744acb20fb84505'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.143306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21eab040d6fc4fd29744acb20fb84505'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.143924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21eab040d6fc4fd29744acb20fb84505'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.150907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21eab040d6fc4fd29744acb20fb84505'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.158071 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:10.170699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1301/2629] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:26:09 2022] DELETE /identity/v3/users/21eab040d6fc4fd29744acb20fb84505 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:10.175892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8cef-36d5-4534-9f34-c3a29c92fdc2 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:10.176423 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8cef-36d5-4534-9f34-c3a29c92fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:10.176647 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8cef-36d5-4534-9f34-c3a29c92fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:10.186010 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:10.197852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c7bf8cef-36d5-4534-9f34-c3a29c92fdc2 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:10.199189 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c7bf8cef-36d5-4534-9f34-c3a29c92fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:10.271187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1329/2630] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:10.280862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:10.282253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:10.350022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e175cd-e894-4fd6-afd4-43440fea7274 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:10.357350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979da35c-374a-4e4a-93eb-14e599053bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:10.357980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da35c-374a-4e4a-93eb-14e599053bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:10.358256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da35c-374a-4e4a-93eb-14e599053bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:10.358521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979da35c-374a-4e4a-93eb-14e599053bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:10.375918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979da35c-374a-4e4a-93eb-14e599053bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:10.377518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979da35c-374a-4e4a-93eb-14e599053bc8 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:10.402335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1302/2631] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:10.723863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf8cef-36d5-4534-9f34-c3a29c92fdc2 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:10.725347 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c7bf8cef-36d5-4534-9f34-c3a29c92fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:10.742003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf8cef-36d5-4534-9f34-c3a29c92fdc2 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:10.770898 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:10.772265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:10.772485 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:10.772759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] PATH_INFO: `/v3/projects/e68ddd83d26040e08138d028e505fa1e` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:10.774080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68ddd83d26040e08138d028e505fa1e)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:10.776681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:10.830474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68ddd83d26040e08138d028e505fa1e', 'request_id': 'req-eb92d06f-377a-4055-82ba-a81a1072a048'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.837577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68ddd83d26040e08138d028e505fa1e', 'request_id': 'req-eb92d06f-377a-4055-82ba-a81a1072a048'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.847502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68ddd83d26040e08138d028e505fa1e', 'request_id': 'req-eb92d06f-377a-4055-82ba-a81a1072a048'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.859298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] The token cache is being invalidate because project e68ddd83d26040e08138d028e505fa1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:26:10.859591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.860255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:26:10.861735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1330/2632] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:26:10 2022] DELETE /identity/v3/projects/e68ddd83d26040e08138d028e505fa1e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:26:20.389529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=30,keystone:DELETE=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:20.855401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:26.043882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9b1ee-959e-4110-9291-0a53fcda620e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:26.044385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9b1ee-959e-4110-9291-0a53fcda620e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:26.044491 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9b1ee-959e-4110-9291-0a53fcda620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:26.083268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-68e9b1ee-959e-4110-9291-0a53fcda620e None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:26:26.084472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-68e9b1ee-959e-4110-9291-0a53fcda620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:26.162332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1303/2633] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:26:26.175192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:26.176712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:26.272781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92d06f-377a-4055-82ba-a81a1072a048 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:26.278118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:26.278720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:26.279017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:26.279294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:26.287281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:26.288877 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:26.298450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1331/2634] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:26:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:26:36.097154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9b1ee-959e-4110-9291-0a53fcda620e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:36.098552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-68e9b1ee-959e-4110-9291-0a53fcda620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:36.186420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9b1ee-959e-4110-9291-0a53fcda620e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:36.191242 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:36.191836 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:36.192112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:36.192383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:36.194031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:36.205179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:36.206725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:36.217225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1304/2635] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:36.294588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=43 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:46.212463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:26:50.625422 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:50.626864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:50.719908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af16c8-1685-4a35-99d2-b2608f19c7e3 service swift] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:50.723950 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:50.724859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:50.725139 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:50.725411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:50.727688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:50.806236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:50.808523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:50.821389 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1332/2636] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:26:56.798773 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:26:56.808263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de8c70-fe26-4c21-9794-40a2f11d0c5d service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:26:56.811791 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:26:56.812392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:26:56.812673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:26:56.812947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:26:56.814723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:26:56.899350 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:26:56.901399 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:26:56.920433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1305/2637] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:00.814788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=57 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:04.045715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:04.047332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.069261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb81761-86f2-4e79-8453-9fe0320c9b14 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:04.074305 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:04.074969 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.075321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.075599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] PATH_INFO: `/v3/users/f09f6b51114648fbbdc3126e597a0a66` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.076777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09f6b51114648fbbdc3126e597a0a66)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:04.078702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:04.135251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09f6b51114648fbbdc3126e597a0a66'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.143876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09f6b51114648fbbdc3126e597a0a66'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.144584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09f6b51114648fbbdc3126e597a0a66'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.145210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09f6b51114648fbbdc3126e597a0a66'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.157286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09f6b51114648fbbdc3126e597a0a66'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.170082 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1333/2638] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:04 2022] DELETE /identity/v3/users/f09f6b51114648fbbdc3126e597a0a66 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:04.341070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:04.350716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f0edf-3e54-419b-8fe3-694f6a77996d service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:04.408723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:04.409357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.409638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.409952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] PATH_INFO: `/v3/projects/176cb70c0db546499a450fe57fdcb984` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.411089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] RBAC: Authorizing `identity:delete_project(project_id=176cb70c0db546499a450fe57fdcb984)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:04.412956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:04.460111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176cb70c0db546499a450fe57fdcb984', 'request_id': 'req-468ce5eb-366d-4aab-ae65-8df52c96089b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.466766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176cb70c0db546499a450fe57fdcb984', 'request_id': 'req-468ce5eb-366d-4aab-ae65-8df52c96089b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.474347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176cb70c0db546499a450fe57fdcb984', 'request_id': 'req-468ce5eb-366d-4aab-ae65-8df52c96089b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.479495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:04.486694 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] The token cache is being invalidate because project 176cb70c0db546499a450fe57fdcb984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:04.487239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.488147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.489893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1306/2639] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:04 2022] DELETE /identity/v3/projects/176cb70c0db546499a450fe57fdcb984 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:04.494890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:04.496350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.509619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38d03-0d23-46b7-b72d-5d823dcf8ef5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:04.566966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:04.567746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.567927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.568204 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] PATH_INFO: `/v3/users/bd77b98bde964701aed2c2662e39e686` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.569383 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd77b98bde964701aed2c2662e39e686)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:04.571458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:04.626123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd77b98bde964701aed2c2662e39e686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.634500 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd77b98bde964701aed2c2662e39e686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.635263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd77b98bde964701aed2c2662e39e686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.635961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd77b98bde964701aed2c2662e39e686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.656720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd77b98bde964701aed2c2662e39e686'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.659342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:04.671864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1334/2640] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:04 2022] DELETE /identity/v3/users/bd77b98bde964701aed2c2662e39e686 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:04.856450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:04.858374 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:04.873412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce5eb-366d-4aab-ae65-8df52c96089b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:04.934408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:04.935058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:04.935340 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:04.935613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] PATH_INFO: `/v3/projects/6b17107b79ac4035bfb9164b5aae4ccf` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:04.936916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b17107b79ac4035bfb9164b5aae4ccf)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:04.938823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:04.987709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b17107b79ac4035bfb9164b5aae4ccf', 'request_id': 'req-6462aaf4-4aab-4e74-8371-281ed80f9519'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:04.996195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b17107b79ac4035bfb9164b5aae4ccf', 'request_id': 'req-6462aaf4-4aab-4e74-8371-281ed80f9519'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.003454 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b17107b79ac4035bfb9164b5aae4ccf', 'request_id': 'req-6462aaf4-4aab-4e74-8371-281ed80f9519'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.013673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] The token cache is being invalidate because project 6b17107b79ac4035bfb9164b5aae4ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:05.013962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.014577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:05.016172 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1307/2641] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:04 2022] DELETE /identity/v3/projects/6b17107b79ac4035bfb9164b5aae4ccf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:05.870542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:05.872017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:05.929535 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f94bb-1c03-4e44-8ba1-0239e3f2ef75 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:05.978405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:05.978986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:05.979288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:05.979559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:05.981265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:06.043798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:06.045179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:06.054977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1335/2642] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:09.170894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.172729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:09.186466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462aaf4-4aab-4e74-8371-281ed80f9519 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.191097 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.191728 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.192011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.192291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] PATH_INFO: `/v3/users/1e53d46902444c0fb0ab0e56960ff8c2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.193412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e53d46902444c0fb0ab0e56960ff8c2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.195392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.243420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e53d46902444c0fb0ab0e56960ff8c2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.252269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e53d46902444c0fb0ab0e56960ff8c2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.253188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e53d46902444c0fb0ab0e56960ff8c2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.253851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e53d46902444c0fb0ab0e56960ff8c2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.262953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-4e412314-d37e-407a-8470-b8886569f903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e53d46902444c0fb0ab0e56960ff8c2'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.276247 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:09.282313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1308/2643] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:09 2022] DELETE /identity/v3/users/1e53d46902444c0fb0ab0e56960ff8c2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:09.462495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.472907 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b986ff-0d0b-4ca1-9132-07ee15d50c9d service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.526880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:09.533210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.533842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.534123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.534398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] PATH_INFO: `/v3/projects/e95334212c8841d98db895c351fbfdfe` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.535538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95334212c8841d98db895c351fbfdfe)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.537432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.585493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95334212c8841d98db895c351fbfdfe', 'request_id': 'req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.591741 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95334212c8841d98db895c351fbfdfe', 'request_id': 'req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.598657 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95334212c8841d98db895c351fbfdfe', 'request_id': 'req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.610042 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] The token cache is being invalidate because project e95334212c8841d98db895c351fbfdfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:09.610339 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.610963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-6ebd964b-e435-4cc8-9bd9-3d36f84802a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:09.612524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1336/2644] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:09 2022] DELETE /identity/v3/projects/e95334212c8841d98db895c351fbfdfe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:09.617569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e269f-6029-4ee0-87ab-0475d5e697f5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.617915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e269f-6029-4ee0-87ab-0475d5e697f5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.618199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e269f-6029-4ee0-87ab-0475d5e697f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.676267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-187e269f-6029-4ee0-87ab-0475d5e697f5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:09.677475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-187e269f-6029-4ee0-87ab-0475d5e697f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:09.736124 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1309/2645] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:09.744295 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6f559-b721-4cef-b564-156e471237bb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.744575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6f559-b721-4cef-b564-156e471237bb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.744850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6f559-b721-4cef-b564-156e471237bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.765207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c3a6f559-b721-4cef-b564-156e471237bb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:09.766399 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c3a6f559-b721-4cef-b564-156e471237bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:09.774924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1337/2646] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:09.779110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e269f-6029-4ee0-87ab-0475d5e697f5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.788660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e269f-6029-4ee0-87ab-0475d5e697f5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.793244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.793831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.794110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.794385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.795050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:09.795358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.796920 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.808877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1310/2647] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:09.812968 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6f559-b721-4cef-b564-156e471237bb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.823097 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6f559-b721-4cef-b564-156e471237bb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.827833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f1ac0-0ab8-49a2-b95c-dcf5ee5d3991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.828436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1ac0-0ab8-49a2-b95c-dcf5ee5d3991 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.828751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1ac0-0ab8-49a2-b95c-dcf5ee5d3991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.829143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f1ac0-0ab8-49a2-b95c-dcf5ee5d3991 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.829784 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f1ac0-0ab8-49a2-b95c-dcf5ee5d3991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.831746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f1ac0-0ab8-49a2-b95c-dcf5ee5d3991 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.861962 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1338/2648] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:09 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:09.863024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.873771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed4489-3822-4314-b03f-19f1c4817b7d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.928560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d8394-19dd-4cc6-910a-9b450f8b0693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.929160 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d8394-19dd-4cc6-910a-9b450f8b0693 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.929445 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d8394-19dd-4cc6-910a-9b450f8b0693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.929718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d8394-19dd-4cc6-910a-9b450f8b0693 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.930892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d8394-19dd-4cc6-910a-9b450f8b0693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.932810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d8394-19dd-4cc6-910a-9b450f8b0693 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.954239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1311/2649] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:09 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:09.958017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f1ac0-0ab8-49a2-b95c-dcf5ee5d3991 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:09.968986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f1ac0-0ab8-49a2-b95c-dcf5ee5d3991 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:09.973676 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a0d54-1306-40a7-87f0-6b22800d00fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:09.974287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a0d54-1306-40a7-87f0-6b22800d00fa admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:09.974568 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a0d54-1306-40a7-87f0-6b22800d00fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:09.974844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a0d54-1306-40a7-87f0-6b22800d00fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:09.975552 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a0d54-1306-40a7-87f0-6b22800d00fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:09.977491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a0d54-1306-40a7-87f0-6b22800d00fa admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:09.988173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1339/2650] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:09.992206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d8394-19dd-4cc6-910a-9b450f8b0693 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:10.003191 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d8394-19dd-4cc6-910a-9b450f8b0693 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:10.009275 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c259e-2661-4434-8b38-179bfd2af042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:10.010042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c259e-2661-4434-8b38-179bfd2af042 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.010354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c259e-2661-4434-8b38-179bfd2af042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.010632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c259e-2661-4434-8b38-179bfd2af042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.011314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c259e-2661-4434-8b38-179bfd2af042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:10.012904 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c259e-2661-4434-8b38-179bfd2af042 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:10.024199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1312/2651] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:10.028527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a0d54-1306-40a7-87f0-6b22800d00fa admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:10.038604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a0d54-1306-40a7-87f0-6b22800d00fa admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:10.043225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:10.043874 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.044156 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.044433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] PATH_INFO: `/v3/projects/f1eab87474af4146b3d52fbb4f5bce2d/users/5ca8c89531e2432d8b9d98c45e6bdd4a/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.060178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1eab87474af4146b3d52fbb4f5bce2d, user_id=5ca8c89531e2432d8b9d98c45e6bdd4a, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:10.062809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:10.077791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1340/2652] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:10 2022] PUT /identity/v3/projects/f1eab87474af4146b3d52fbb4f5bce2d/users/5ca8c89531e2432d8b9d98c45e6bdd4a/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:10.082905 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7eb7c-70da-4ea0-a2f1-f70ac5d37d9d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.083286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7eb7c-70da-4ea0-a2f1-f70ac5d37d9d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.083573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7eb7c-70da-4ea0-a2f1-f70ac5d37d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.103714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9fb7eb7c-70da-4ea0-a2f1-f70ac5d37d9d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:10.104921 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9fb7eb7c-70da-4ea0-a2f1-f70ac5d37d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:10.134257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:10.165272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1313/2653] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:10.174835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:10.176581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:10.234832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a7e1a-32ba-43a6-9b78-f67d49c6bc50 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:10.238498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:10.239134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:10.239415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:10.239691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:10.249266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:10.250692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:10.260141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1341/2654] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:14.506105 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd9d3-9d88-48d9-99e2-25b911588a18 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:14.506717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd9d3-9d88-48d9-99e2-25b911588a18 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:14.506717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd9d3-9d88-48d9-99e2-25b911588a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:14.536999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-943dd9d3-9d88-48d9-99e2-25b911588a18 None None] MFA Rules not processed for user `5ca8c89531e2432d8b9d98c45e6bdd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:14.538243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-943dd9d3-9d88-48d9-99e2-25b911588a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.609052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1314/2655] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:14.634493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:14.636199 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:14.672159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:14.744465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4637cc58-fdaf-4ee1-a4f7-efd8323dfde9 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:14.750891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7de6-8acc-40fb-9283-9bd824aa60cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:14.751635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7de6-8acc-40fb-9283-9bd824aa60cc service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:14.751982 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7de6-8acc-40fb-9283-9bd824aa60cc service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:14.752326 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b7de6-8acc-40fb-9283-9bd824aa60cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:14.761889 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b7de6-8acc-40fb-9283-9bd824aa60cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:14.763598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b7de6-8acc-40fb-9283-9bd824aa60cc service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:14.773329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1342/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:16.079345 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74df624-ae3e-4285-9654-1c16b1303fde None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:16.079875 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74df624-ae3e-4285-9654-1c16b1303fde None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:16.080006 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74df624-ae3e-4285-9654-1c16b1303fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:16.099544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-e74df624-ae3e-4285-9654-1c16b1303fde None None] MFA Rules not processed for user `5ca8c89531e2432d8b9d98c45e6bdd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:16.100757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e74df624-ae3e-4285-9654-1c16b1303fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:16.107704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1315/2657] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:24.768923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=31 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:26.093949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=47 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:31.678148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7de6-8acc-40fb-9283-9bd824aa60cc service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:31.688092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b7de6-8acc-40fb-9283-9bd824aa60cc service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:31.692069 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:31.692471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:31.692749 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:31.693024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:31.695458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:31.707916 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:31.708796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:31.719567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1343/2658] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:34.824967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74df624-ae3e-4285-9654-1c16b1303fde None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:34.826499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e74df624-ae3e-4285-9654-1c16b1303fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:34.842282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74df624-ae3e-4285-9654-1c16b1303fde None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:34.846800 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:34.847464 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:34.847745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:34.848023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] PATH_INFO: `/v3/users/047780e830d14ab8a1cdb9a6061cb939` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:34.849139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] RBAC: Authorizing `identity:delete_user(user_id=047780e830d14ab8a1cdb9a6061cb939)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:34.851817 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:34.899192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047780e830d14ab8a1cdb9a6061cb939'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:34.906564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047780e830d14ab8a1cdb9a6061cb939'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:34.907280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047780e830d14ab8a1cdb9a6061cb939'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:34.907891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047780e830d14ab8a1cdb9a6061cb939'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:34.915457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-b55f7193-fc22-4a72-9688-6af4efb6645f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047780e830d14ab8a1cdb9a6061cb939'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:34.933077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1316/2659] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:34 2022] DELETE /identity/v3/users/047780e830d14ab8a1cdb9a6061cb939 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:35.103980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.113834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac62770-bbf5-4f8e-9236-c33a02386905 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.171020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.171654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.171935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.172213 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] PATH_INFO: `/v3/projects/e3dfbe37504f4632af17f6ec95a9fdbb` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.173315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3dfbe37504f4632af17f6ec95a9fdbb)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.175390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.222356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3dfbe37504f4632af17f6ec95a9fdbb', 'request_id': 'req-193ee7dd-1555-48ea-9afa-e2799192eb05'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:35.229116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3dfbe37504f4632af17f6ec95a9fdbb', 'request_id': 'req-193ee7dd-1555-48ea-9afa-e2799192eb05'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:35.235804 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3dfbe37504f4632af17f6ec95a9fdbb', 'request_id': 'req-193ee7dd-1555-48ea-9afa-e2799192eb05'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:35.246354 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] The token cache is being invalidate because project e3dfbe37504f4632af17f6ec95a9fdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:35.246648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:35.247307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-193ee7dd-1555-48ea-9afa-e2799192eb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:35.248777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1344/2660] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:35 2022] DELETE /identity/v3/projects/e3dfbe37504f4632af17f6ec95a9fdbb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:35.253674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ec0d7-1c17-456d-948c-675b096a5c3b None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.253960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ec0d7-1c17-456d-948c-675b096a5c3b None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.254237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ec0d7-1c17-456d-948c-675b096a5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.274783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-bf8ec0d7-1c17-456d-948c-675b096a5c3b None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:35.276100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bf8ec0d7-1c17-456d-948c-675b096a5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:35.335443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1317/2661] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:35.343169 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf201a2-e3ee-4f4a-a67c-fedd670c42a3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.343454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf201a2-e3ee-4f4a-a67c-fedd670c42a3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.343745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf201a2-e3ee-4f4a-a67c-fedd670c42a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.363572 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ddf201a2-e3ee-4f4a-a67c-fedd670c42a3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:35.364776 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ddf201a2-e3ee-4f4a-a67c-fedd670c42a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:35.373361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1345/2662] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:35.377566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ec0d7-1c17-456d-948c-675b096a5c3b None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.387823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ec0d7-1c17-456d-948c-675b096a5c3b None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.392385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.392978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.393258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.393535 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.394176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:35.394480 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.396107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.407381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1318/2663] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:35.411541 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf201a2-e3ee-4f4a-a67c-fedd670c42a3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.421055 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf201a2-e3ee-4f4a-a67c-fedd670c42a3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.426153 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466248-26c3-4aa6-8362-6a71f00d311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.426756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466248-26c3-4aa6-8362-6a71f00d311f admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.427060 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466248-26c3-4aa6-8362-6a71f00d311f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.427345 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466248-26c3-4aa6-8362-6a71f00d311f admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.427999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466248-26c3-4aa6-8362-6a71f00d311f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.430446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466248-26c3-4aa6-8362-6a71f00d311f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.458260 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1346/2664] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:35 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:35.462713 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.472594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a9dc8-8d23-4a48-ab15-a271b69f7c1e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.529079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27036976-f991-422b-8da5-338a6b5b841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.529677 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27036976-f991-422b-8da5-338a6b5b841d admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.529964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27036976-f991-422b-8da5-338a6b5b841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.530241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27036976-f991-422b-8da5-338a6b5b841d admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.530881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27036976-f991-422b-8da5-338a6b5b841d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.532890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27036976-f991-422b-8da5-338a6b5b841d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.540759 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:35.555938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1319/2665] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:35 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:35.559980 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466248-26c3-4aa6-8362-6a71f00d311f admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.571077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466248-26c3-4aa6-8362-6a71f00d311f admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.575645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de368921-9068-47f5-9e02-fe267f205c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.576235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de368921-9068-47f5-9e02-fe267f205c18 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.576512 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de368921-9068-47f5-9e02-fe267f205c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.576781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de368921-9068-47f5-9e02-fe267f205c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.577419 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de368921-9068-47f5-9e02-fe267f205c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.579001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de368921-9068-47f5-9e02-fe267f205c18 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.589322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1347/2666] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:35.593070 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27036976-f991-422b-8da5-338a6b5b841d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.603256 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27036976-f991-422b-8da5-338a6b5b841d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.607851 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d06cbc-b46b-4f3d-92d3-31ae3992d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.608462 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06cbc-b46b-4f3d-92d3-31ae3992d58a admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.608736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06cbc-b46b-4f3d-92d3-31ae3992d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.609007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06cbc-b46b-4f3d-92d3-31ae3992d58a admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.609663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d06cbc-b46b-4f3d-92d3-31ae3992d58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.611250 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d06cbc-b46b-4f3d-92d3-31ae3992d58a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.622540 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1320/2667] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:35.626970 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de368921-9068-47f5-9e02-fe267f205c18 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.637365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de368921-9068-47f5-9e02-fe267f205c18 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.642025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.642663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.642940 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.643236 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] PATH_INFO: `/v3/projects/b820a5170cf3482e84a5526c823288c3/users/d441686c34f74a908af9f39e6e225e7e/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.657638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b820a5170cf3482e84a5526c823288c3, user_id=d441686c34f74a908af9f39e6e225e7e, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.660281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.674401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1348/2668] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:35 2022] PUT /identity/v3/projects/b820a5170cf3482e84a5526c823288c3/users/d441686c34f74a908af9f39e6e225e7e/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:35.685765 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79986cd6-0f19-473e-91e5-fdf9198e53c8 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.686047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79986cd6-0f19-473e-91e5-fdf9198e53c8 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.686319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79986cd6-0f19-473e-91e5-fdf9198e53c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.713947 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-79986cd6-0f19-473e-91e5-fdf9198e53c8 None None] MFA Rules not processed for user `d441686c34f74a908af9f39e6e225e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:35.715180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-79986cd6-0f19-473e-91e5-fdf9198e53c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:35.779035 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1321/2669] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:35.790361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:35.792081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:35.807337 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:35.868642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ce70-2a93-4b31-87eb-64bd49d149f1 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:35.874229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14275388-6874-42ee-b782-2f6ce21daef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:35.874839 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14275388-6874-42ee-b782-2f6ce21daef5 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:35.875160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14275388-6874-42ee-b782-2f6ce21daef5 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:35.875441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14275388-6874-42ee-b782-2f6ce21daef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:35.883917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14275388-6874-42ee-b782-2f6ce21daef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:35.885821 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14275388-6874-42ee-b782-2f6ce21daef5 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:35.894965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1349/2670] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:41.262364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79986cd6-0f19-473e-91e5-fdf9198e53c8 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:41.320027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79986cd6-0f19-473e-91e5-fdf9198e53c8 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:41.325358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:41.325977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:41.326257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:41.326528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] PATH_INFO: `/v3/users/d441686c34f74a908af9f39e6e225e7e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:41.327651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d441686c34f74a908af9f39e6e225e7e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:41.329542 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:41.375929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd441686c34f74a908af9f39e6e225e7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.382959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd441686c34f74a908af9f39e6e225e7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.383607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd441686c34f74a908af9f39e6e225e7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.385008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd441686c34f74a908af9f39e6e225e7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.391830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd441686c34f74a908af9f39e6e225e7e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.396904 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:41.410190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1322/2671] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:27:41 2022] DELETE /identity/v3/users/d441686c34f74a908af9f39e6e225e7e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:41.414617 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a346-f46f-4ccd-ac04-4b99ac9576e1 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:41.415183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a346-f46f-4ccd-ac04-4b99ac9576e1 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:41.415283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527a346-f46f-4ccd-ac04-4b99ac9576e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:41.434654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e527a346-f46f-4ccd-ac04-4b99ac9576e1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:41.435957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e527a346-f46f-4ccd-ac04-4b99ac9576e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:41.495195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1350/2672] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:41.504834 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:41.506196 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:41.562313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d3de7-19e7-4193-923f-9fb7e93306e8 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:41.565960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31280c-5ca2-4a45-8eb5-00edf913a9a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:41.566561 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31280c-5ca2-4a45-8eb5-00edf913a9a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:41.566839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31280c-5ca2-4a45-8eb5-00edf913a9a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:41.567147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31280c-5ca2-4a45-8eb5-00edf913a9a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:41.576667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31280c-5ca2-4a45-8eb5-00edf913a9a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:41.578073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31280c-5ca2-4a45-8eb5-00edf913a9a3 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:41.587745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1323/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:41.860912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527a346-f46f-4ccd-ac04-4b99ac9576e1 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:41.862360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e527a346-f46f-4ccd-ac04-4b99ac9576e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:41.876065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527a346-f46f-4ccd-ac04-4b99ac9576e1 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:41.880555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:41.881183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:41.881459 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:41.881736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] PATH_INFO: `/v3/projects/b820a5170cf3482e84a5526c823288c3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:41.883350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b820a5170cf3482e84a5526c823288c3)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:41.885488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:41.933372 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b820a5170cf3482e84a5526c823288c3', 'request_id': 'req-14083ca3-2d6f-40b9-a1aa-4e19242740f1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.939698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b820a5170cf3482e84a5526c823288c3', 'request_id': 'req-14083ca3-2d6f-40b9-a1aa-4e19242740f1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.947560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b820a5170cf3482e84a5526c823288c3', 'request_id': 'req-14083ca3-2d6f-40b9-a1aa-4e19242740f1'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.958085 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] The token cache is being invalidate because project b820a5170cf3482e84a5526c823288c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:27:41.958373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.959004 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-14083ca3-2d6f-40b9-a1aa-4e19242740f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:27:41.960760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1351/2674] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:27:41 2022] DELETE /identity/v3/projects/b820a5170cf3482e84a5526c823288c3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:27:41.966435 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd1dbc-66e1-45ca-a20b-d70be2e37e44 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:41.966746 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd1dbc-66e1-45ca-a20b-d70be2e37e44 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:41.967045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd1dbc-66e1-45ca-a20b-d70be2e37e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:41.987257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-dafd1dbc-66e1-45ca-a20b-d70be2e37e44 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:41.988502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-dafd1dbc-66e1-45ca-a20b-d70be2e37e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:42.048985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1324/2675] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:42.058035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e895f-ec5d-4747-8ea9-7a35556dd330 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.058315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e895f-ec5d-4747-8ea9-7a35556dd330 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.058588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e895f-ec5d-4747-8ea9-7a35556dd330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.079721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-a51e895f-ec5d-4747-8ea9-7a35556dd330 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:42.080936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a51e895f-ec5d-4747-8ea9-7a35556dd330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:42.089827 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1352/2676] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:42.094114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd1dbc-66e1-45ca-a20b-d70be2e37e44 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.104436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd1dbc-66e1-45ca-a20b-d70be2e37e44 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.108954 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.109552 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.109831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.110106 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.110749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:27:42.111089 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.112661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.124182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1325/2677] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:27:42.128298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e895f-ec5d-4747-8ea9-7a35556dd330 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.137492 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e895f-ec5d-4747-8ea9-7a35556dd330 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.142688 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47c6fc-1eb3-4a3a-98a1-23f5aab287e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.143403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47c6fc-1eb3-4a3a-98a1-23f5aab287e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.143683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47c6fc-1eb3-4a3a-98a1-23f5aab287e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.144080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47c6fc-1eb3-4a3a-98a1-23f5aab287e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.144625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47c6fc-1eb3-4a3a-98a1-23f5aab287e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.146673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47c6fc-1eb3-4a3a-98a1-23f5aab287e2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.163081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:42.177195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1353/2678] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:42.181292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.192762 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdb034-7ec9-49d1-8cdc-5fce0015d321 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.248755 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e417-2c05-4c93-9f5c-0dec50094953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.249364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e417-2c05-4c93-9f5c-0dec50094953 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.249641 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e417-2c05-4c93-9f5c-0dec50094953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.249913 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58e417-2c05-4c93-9f5c-0dec50094953 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.250539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e417-2c05-4c93-9f5c-0dec50094953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.252465 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58e417-2c05-4c93-9f5c-0dec50094953 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.274850 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1326/2679] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:42.279202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47c6fc-1eb3-4a3a-98a1-23f5aab287e2 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.289484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47c6fc-1eb3-4a3a-98a1-23f5aab287e2 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.294881 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e04f6-87c8-4e49-ac2b-2576f8aca484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.295525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e04f6-87c8-4e49-ac2b-2576f8aca484 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.295807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e04f6-87c8-4e49-ac2b-2576f8aca484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.296080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e04f6-87c8-4e49-ac2b-2576f8aca484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.296719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e04f6-87c8-4e49-ac2b-2576f8aca484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.298329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e04f6-87c8-4e49-ac2b-2576f8aca484 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.308476 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1354/2680] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:42.312573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e417-2c05-4c93-9f5c-0dec50094953 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.322685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58e417-2c05-4c93-9f5c-0dec50094953 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.327319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f611cb5-4f21-49ec-a403-bf315f4c5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.327937 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f611cb5-4f21-49ec-a403-bf315f4c5799 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.328220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f611cb5-4f21-49ec-a403-bf315f4c5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.328495 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f611cb5-4f21-49ec-a403-bf315f4c5799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.329134 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f611cb5-4f21-49ec-a403-bf315f4c5799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.330699 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f611cb5-4f21-49ec-a403-bf315f4c5799 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.331945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:42.344499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1327/2681] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:42.348394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e04f6-87c8-4e49-ac2b-2576f8aca484 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.358853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e04f6-87c8-4e49-ac2b-2576f8aca484 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.363509 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12ba88-762b-4ae2-94fc-5c25ccee5363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.364147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ba88-762b-4ae2-94fc-5c25ccee5363 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.364428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ba88-762b-4ae2-94fc-5c25ccee5363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.364703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12ba88-762b-4ae2-94fc-5c25ccee5363 admin admin] PATH_INFO: `/v3/projects/d9d55bfb9ee845a5b7892df8cefb90e3/users/578b91b910504126b6ab619e9c66b722/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.502022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12ba88-762b-4ae2-94fc-5c25ccee5363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d55bfb9ee845a5b7892df8cefb90e3, user_id=578b91b910504126b6ab619e9c66b722, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.504667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12ba88-762b-4ae2-94fc-5c25ccee5363 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.518178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1355/2682] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:42 2022] PUT /identity/v3/projects/d9d55bfb9ee845a5b7892df8cefb90e3/users/578b91b910504126b6ab619e9c66b722/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:42.529312 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c0d2a-5a08-4426-94c6-4444e38696b5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.529603 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c0d2a-5a08-4426-94c6-4444e38696b5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.529915 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c0d2a-5a08-4426-94c6-4444e38696b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.558934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-282c0d2a-5a08-4426-94c6-4444e38696b5 None None] MFA Rules not processed for user `578b91b910504126b6ab619e9c66b722`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:42.560186 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-282c0d2a-5a08-4426-94c6-4444e38696b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:42.623575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1328/2683] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:42.628159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12ba88-762b-4ae2-94fc-5c25ccee5363 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.688983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12ba88-762b-4ae2-94fc-5c25ccee5363 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.693667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76903f-f54c-4cde-8a60-bb9bceae3f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.694257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76903f-f54c-4cde-8a60-bb9bceae3f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.694530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76903f-f54c-4cde-8a60-bb9bceae3f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.694795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76903f-f54c-4cde-8a60-bb9bceae3f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.695456 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76903f-f54c-4cde-8a60-bb9bceae3f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.698365 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76903f-f54c-4cde-8a60-bb9bceae3f85 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.725245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1356/2684] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:27:42.729555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c0d2a-5a08-4426-94c6-4444e38696b5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.740306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c0d2a-5a08-4426-94c6-4444e38696b5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.796343 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08afb2-8ea9-499c-a1e8-8604f6fea9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.796855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08afb2-8ea9-499c-a1e8-8604f6fea9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.797139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08afb2-8ea9-499c-a1e8-8604f6fea9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.797415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08afb2-8ea9-499c-a1e8-8604f6fea9ca admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.798076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08afb2-8ea9-499c-a1e8-8604f6fea9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.800000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08afb2-8ea9-499c-a1e8-8604f6fea9ca admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.822098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1329/2685] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:27:42 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:27:42.826695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76903f-f54c-4cde-8a60-bb9bceae3f85 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.839802 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76903f-f54c-4cde-8a60-bb9bceae3f85 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.845061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13bdb5-42ae-48cc-a7f0-eec70caa567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.845888 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13bdb5-42ae-48cc-a7f0-eec70caa567e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.846294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13bdb5-42ae-48cc-a7f0-eec70caa567e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.846695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13bdb5-42ae-48cc-a7f0-eec70caa567e admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.847633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13bdb5-42ae-48cc-a7f0-eec70caa567e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.849892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13bdb5-42ae-48cc-a7f0-eec70caa567e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.861430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1357/2686] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:42.865617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08afb2-8ea9-499c-a1e8-8604f6fea9ca admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.876164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08afb2-8ea9-499c-a1e8-8604f6fea9ca admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.880740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf21ec-d47b-4914-8dea-4837050a855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.881384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf21ec-d47b-4914-8dea-4837050a855c admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.881667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf21ec-d47b-4914-8dea-4837050a855c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.881942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf21ec-d47b-4914-8dea-4837050a855c admin admin] PATH_INFO: `/v3/projects/4dd75e0ba5bb4e1799766d5150839bba/users/2ffb6e492e98446cbfa7fa45dc567ebb/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.897289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf21ec-d47b-4914-8dea-4837050a855c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd75e0ba5bb4e1799766d5150839bba, user_id=2ffb6e492e98446cbfa7fa45dc567ebb, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.900620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf21ec-d47b-4914-8dea-4837050a855c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.913438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1330/2687] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:42 2022] PUT /identity/v3/projects/4dd75e0ba5bb4e1799766d5150839bba/users/2ffb6e492e98446cbfa7fa45dc567ebb/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:42.918230 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13bdb5-42ae-48cc-a7f0-eec70caa567e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:42.927971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13bdb5-42ae-48cc-a7f0-eec70caa567e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:42.984332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14475427-ba14-41f9-ae01-7b62c099d8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:42.984933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475427-ba14-41f9-ae01-7b62c099d8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:42.985210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475427-ba14-41f9-ae01-7b62c099d8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:42.985479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14475427-ba14-41f9-ae01-7b62c099d8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:42.986142 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14475427-ba14-41f9-ae01-7b62c099d8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:42.987855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14475427-ba14-41f9-ae01-7b62c099d8d2 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:42.997472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1358/2688] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:27:43.001909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf21ec-d47b-4914-8dea-4837050a855c admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.012210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf21ec-d47b-4914-8dea-4837050a855c admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.016745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.017384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.017663 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.017938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] PATH_INFO: `/v3/projects/4dd75e0ba5bb4e1799766d5150839bba/users/2ffb6e492e98446cbfa7fa45dc567ebb/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.019842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd75e0ba5bb4e1799766d5150839bba, user_id=2ffb6e492e98446cbfa7fa45dc567ebb, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.022469 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.033341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1331/2689] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:27:43 2022] PUT /identity/v3/projects/4dd75e0ba5bb4e1799766d5150839bba/users/2ffb6e492e98446cbfa7fa45dc567ebb/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:27:43.043986 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705b34e-baa8-47aa-81de-b2ea15b607dd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.044270 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705b34e-baa8-47aa-81de-b2ea15b607dd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.044543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705b34e-baa8-47aa-81de-b2ea15b607dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.071656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-4705b34e-baa8-47aa-81de-b2ea15b607dd None None] MFA Rules not processed for user `2ffb6e492e98446cbfa7fa45dc567ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:27:43.072913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-4705b34e-baa8-47aa-81de-b2ea15b607dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.090508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:43.145307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1359/2690] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:27:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:27:43.158864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.160589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:27:43.206629 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:43.244408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21da5d7-a4d7-44d5-a931-f9999763d424 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.248066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a543ef-4b60-4afd-add0-dadae629321f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.248666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a543ef-4b60-4afd-add0-dadae629321f service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.248945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a543ef-4b60-4afd-add0-dadae629321f service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.249218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a543ef-4b60-4afd-add0-dadae629321f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.257981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a543ef-4b60-4afd-add0-dadae629321f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.260050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a543ef-4b60-4afd-add0-dadae629321f service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.269353 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1332/2691] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:43.344387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705b34e-baa8-47aa-81de-b2ea15b607dd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:27:43.354561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705b34e-baa8-47aa-81de-b2ea15b607dd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:27:43.358269 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90cdad-ecde-47eb-a860-216fcf60094e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:27:43.358864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90cdad-ecde-47eb-a860-216fcf60094e service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:27:43.359176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90cdad-ecde-47eb-a860-216fcf60094e service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:27:43.359449 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90cdad-ecde-47eb-a860-216fcf60094e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:27:43.416268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90cdad-ecde-47eb-a860-216fcf60094e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:27:43.417681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90cdad-ecde-47eb-a860-216fcf60094e service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:27:43.429864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1360/2692] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:27:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:27:53.265197 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=18 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:27:53.425408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=49 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:12.538544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a543ef-4b60-4afd-add0-dadae629321f service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:12.601523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a543ef-4b60-4afd-add0-dadae629321f service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:12.606673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:12.607335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:12.607617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:12.607893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] PATH_INFO: `/v3/users/578b91b910504126b6ab619e9c66b722` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:12.608999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578b91b910504126b6ab619e9c66b722)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:12.610882 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:12.657669 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578b91b910504126b6ab619e9c66b722'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:12.664782 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578b91b910504126b6ab619e9c66b722'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:12.665394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578b91b910504126b6ab619e9c66b722'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:12.667048 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578b91b910504126b6ab619e9c66b722'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:12.674360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578b91b910504126b6ab619e9c66b722'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:12.691674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1333/2693] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:12 2022] DELETE /identity/v3/users/578b91b910504126b6ab619e9c66b722 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:12.696311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610dc7c-cded-4b37-a743-b3c23eb67964 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:12.697307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610dc7c-cded-4b37-a743-b3c23eb67964 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:12.697675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610dc7c-cded-4b37-a743-b3c23eb67964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:12.716525 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-c610dc7c-cded-4b37-a743-b3c23eb67964 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:12.717703 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c610dc7c-cded-4b37-a743-b3c23eb67964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:12.774192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1361/2694] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:12.784355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:12.785737 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:12.843260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d354556-228a-460c-89a7-dec354d08190 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:12.846873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14b7a-07c5-4c06-84ca-59c6d11384a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:12.847503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14b7a-07c5-4c06-84ca-59c6d11384a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:12.847783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14b7a-07c5-4c06-84ca-59c6d11384a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:12.848059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e14b7a-07c5-4c06-84ca-59c6d11384a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:12.857651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e14b7a-07c5-4c06-84ca-59c6d11384a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:12.859091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e14b7a-07c5-4c06-84ca-59c6d11384a4 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:12.868332 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1334/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:13.131862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610dc7c-cded-4b37-a743-b3c23eb67964 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:13.133315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-c610dc7c-cded-4b37-a743-b3c23eb67964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:13.144933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610dc7c-cded-4b37-a743-b3c23eb67964 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:13.149478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:13.151415 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:13.151867 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:13.152147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] PATH_INFO: `/v3/projects/d9d55bfb9ee845a5b7892df8cefb90e3` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:13.153381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d55bfb9ee845a5b7892df8cefb90e3)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:13.155168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:13.204248 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d55bfb9ee845a5b7892df8cefb90e3', 'request_id': 'req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.210536 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d55bfb9ee845a5b7892df8cefb90e3', 'request_id': 'req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.218559 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d55bfb9ee845a5b7892df8cefb90e3', 'request_id': 'req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.229407 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] The token cache is being invalidate because project d9d55bfb9ee845a5b7892df8cefb90e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:13.229697 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.230329 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.231830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1362/2696] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:13 2022] DELETE /identity/v3/projects/d9d55bfb9ee845a5b7892df8cefb90e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:13.235754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14b7a-07c5-4c06-84ca-59c6d11384a4 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:13.245977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e14b7a-07c5-4c06-84ca-59c6d11384a4 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:13.264294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:13.303249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:13.303804 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:13.304084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:13.304361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] PATH_INFO: `/v3/users/2ffb6e492e98446cbfa7fa45dc567ebb` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:13.305497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ffb6e492e98446cbfa7fa45dc567ebb)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:13.308073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:13.353856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ffb6e492e98446cbfa7fa45dc567ebb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.362090 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ffb6e492e98446cbfa7fa45dc567ebb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.362770 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ffb6e492e98446cbfa7fa45dc567ebb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.363404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ffb6e492e98446cbfa7fa45dc567ebb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.371311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-debc8abb-ed6b-4dda-8b79-c0d6fe648ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ffb6e492e98446cbfa7fa45dc567ebb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.389556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1335/2697] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:13 2022] DELETE /identity/v3/users/2ffb6e492e98446cbfa7fa45dc567ebb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:13.660262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:13.661724 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:13.675228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a41706-d0e3-4cb1-ac28-9f531c26bbc4 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:13.736390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:13.737021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:13.737291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:13.737565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] PATH_INFO: `/v3/projects/4dd75e0ba5bb4e1799766d5150839bba` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:13.738682 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd75e0ba5bb4e1799766d5150839bba)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:13.740610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:13.770252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:13.788191 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd75e0ba5bb4e1799766d5150839bba', 'request_id': 'req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.794686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd75e0ba5bb4e1799766d5150839bba', 'request_id': 'req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.801967 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd75e0ba5bb4e1799766d5150839bba', 'request_id': 'req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.812945 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] The token cache is being invalidate because project 4dd75e0ba5bb4e1799766d5150839bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:13.813233 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.813862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ebf5538c-15c6-4f49-9dfe-b3e6b70199ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:13.815332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1363/2698] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:13 2022] DELETE /identity/v3/projects/4dd75e0ba5bb4e1799766d5150839bba => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:13.820216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64771c86-d5d0-4d77-9be6-6ae5d0e50f96 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:13.820724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64771c86-d5d0-4d77-9be6-6ae5d0e50f96 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:13.820827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64771c86-d5d0-4d77-9be6-6ae5d0e50f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:13.840871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-64771c86-d5d0-4d77-9be6-6ae5d0e50f96 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:13.842010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-64771c86-d5d0-4d77-9be6-6ae5d0e50f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:13.900839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1336/2699] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:13.908811 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee12a-f61e-4afd-9ca6-c676fff512d4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:13.909197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee12a-f61e-4afd-9ca6-c676fff512d4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:13.909469 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ee12a-f61e-4afd-9ca6-c676fff512d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:13.929298 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-289ee12a-f61e-4afd-9ca6-c676fff512d4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:13.930480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-289ee12a-f61e-4afd-9ca6-c676fff512d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:13.938712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1364/2700] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:13.942948 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64771c86-d5d0-4d77-9be6-6ae5d0e50f96 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:13.952777 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64771c86-d5d0-4d77-9be6-6ae5d0e50f96 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:13.957415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:13.958011 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:13.958289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:13.958560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:13.959496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:13.959799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:13.961365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:13.974001 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1337/2701] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:13.978725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ee12a-f61e-4afd-9ca6-c676fff512d4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:13.988059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ee12a-f61e-4afd-9ca6-c676fff512d4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:13.992675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de8f87-853c-4f77-b410-6e99490a30f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:13.993264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de8f87-853c-4f77-b410-6e99490a30f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:13.993919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de8f87-853c-4f77-b410-6e99490a30f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:13.994025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de8f87-853c-4f77-b410-6e99490a30f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:13.994756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de8f87-853c-4f77-b410-6e99490a30f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:13.996675 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de8f87-853c-4f77-b410-6e99490a30f9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.023208 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1365/2702] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:13 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:28:14.027813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.038034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85306831-1b67-43f5-b2ec-34e2df955df9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.064690 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:14.097273 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e094778-0f14-4c29-986a-2caa28293b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.097798 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094778-0f14-4c29-986a-2caa28293b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.098077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094778-0f14-4c29-986a-2caa28293b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.098352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e094778-0f14-4c29-986a-2caa28293b53 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.098981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e094778-0f14-4c29-986a-2caa28293b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.100900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e094778-0f14-4c29-986a-2caa28293b53 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.125815 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1338/2703] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:14 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:14.129895 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de8f87-853c-4f77-b410-6e99490a30f9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.140320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de8f87-853c-4f77-b410-6e99490a30f9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.144761 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218402f-aa8f-4766-88d5-ba970fb5ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.145348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218402f-aa8f-4766-88d5-ba970fb5ba19 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.145625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218402f-aa8f-4766-88d5-ba970fb5ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.145892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218402f-aa8f-4766-88d5-ba970fb5ba19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.146519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218402f-aa8f-4766-88d5-ba970fb5ba19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.148103 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218402f-aa8f-4766-88d5-ba970fb5ba19 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.158565 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1366/2704] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:14.162333 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e094778-0f14-4c29-986a-2caa28293b53 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.173003 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e094778-0f14-4c29-986a-2caa28293b53 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.177890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b8430-8295-4f41-bcac-220cab883217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.178478 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b8430-8295-4f41-bcac-220cab883217 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.178753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b8430-8295-4f41-bcac-220cab883217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.179045 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b8430-8295-4f41-bcac-220cab883217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.179705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b8430-8295-4f41-bcac-220cab883217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.181439 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b8430-8295-4f41-bcac-220cab883217 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.193206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1339/2705] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:14.197822 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218402f-aa8f-4766-88d5-ba970fb5ba19 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.207794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218402f-aa8f-4766-88d5-ba970fb5ba19 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.213235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd838d-5182-4004-8563-d378cd667116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.213868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd838d-5182-4004-8563-d378cd667116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.214151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd838d-5182-4004-8563-d378cd667116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.214426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd838d-5182-4004-8563-d378cd667116 admin admin] PATH_INFO: `/v3/projects/ddc1c1b0f8fd49f2a546beb91a02466b/users/8a2f733fb7ce47d387a6b8a36806e18b/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.228809 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd838d-5182-4004-8563-d378cd667116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc1c1b0f8fd49f2a546beb91a02466b, user_id=8a2f733fb7ce47d387a6b8a36806e18b, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.231460 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd838d-5182-4004-8563-d378cd667116 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.244715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1367/2706] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:14 2022] PUT /identity/v3/projects/ddc1c1b0f8fd49f2a546beb91a02466b/users/8a2f733fb7ce47d387a6b8a36806e18b/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:14.255959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96dd58-f371-4509-8e63-18681c8556c4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.256248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96dd58-f371-4509-8e63-18681c8556c4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.256524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96dd58-f371-4509-8e63-18681c8556c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.284978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5e96dd58-f371-4509-8e63-18681c8556c4 None None] MFA Rules not processed for user `8a2f733fb7ce47d387a6b8a36806e18b`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:14.286187 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5e96dd58-f371-4509-8e63-18681c8556c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.348592 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1340/2707] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:14.353061 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd838d-5182-4004-8563-d378cd667116 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.413641 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd838d-5182-4004-8563-d378cd667116 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.418330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24932-bfeb-4326-b195-1ce2ad96f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.418926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24932-bfeb-4326-b195-1ce2ad96f78c admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.419237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24932-bfeb-4326-b195-1ce2ad96f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.419514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc24932-bfeb-4326-b195-1ce2ad96f78c admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.420138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc24932-bfeb-4326-b195-1ce2ad96f78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.422038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc24932-bfeb-4326-b195-1ce2ad96f78c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.448875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1368/2708] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:14 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:14.453008 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96dd58-f371-4509-8e63-18681c8556c4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.464602 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96dd58-f371-4509-8e63-18681c8556c4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.520095 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8006ef-a7f7-42ba-acf1-c2b78e0bf7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.520705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8006ef-a7f7-42ba-acf1-c2b78e0bf7cb admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.520987 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8006ef-a7f7-42ba-acf1-c2b78e0bf7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.521262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8006ef-a7f7-42ba-acf1-c2b78e0bf7cb admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.521894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8006ef-a7f7-42ba-acf1-c2b78e0bf7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.523864 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8006ef-a7f7-42ba-acf1-c2b78e0bf7cb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.545308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1341/2709] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:14 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:14.549376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24932-bfeb-4326-b195-1ce2ad96f78c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.560281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc24932-bfeb-4326-b195-1ce2ad96f78c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.565238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff5a41-c6cb-4a45-ab13-a665e5094012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.565835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff5a41-c6cb-4a45-ab13-a665e5094012 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.566118 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff5a41-c6cb-4a45-ab13-a665e5094012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.566393 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff5a41-c6cb-4a45-ab13-a665e5094012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.567100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff5a41-c6cb-4a45-ab13-a665e5094012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.568679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff5a41-c6cb-4a45-ab13-a665e5094012 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.580037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1369/2710] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:14.584367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8006ef-a7f7-42ba-acf1-c2b78e0bf7cb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.594248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8006ef-a7f7-42ba-acf1-c2b78e0bf7cb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.598910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ce07-4b04-4570-955d-f78d7bb114a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.599532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ce07-4b04-4570-955d-f78d7bb114a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.599811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ce07-4b04-4570-955d-f78d7bb114a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.600084 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23ce07-4b04-4570-955d-f78d7bb114a4 admin admin] PATH_INFO: `/v3/projects/596ff53b817345b5b7892b273030c734/users/2932e54f11414b0499082b41a648639e/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.614544 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23ce07-4b04-4570-955d-f78d7bb114a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596ff53b817345b5b7892b273030c734, user_id=2932e54f11414b0499082b41a648639e, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.617178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23ce07-4b04-4570-955d-f78d7bb114a4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.631181 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1342/2711] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:14 2022] PUT /identity/v3/projects/596ff53b817345b5b7892b273030c734/users/2932e54f11414b0499082b41a648639e/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:14.635729 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff5a41-c6cb-4a45-ab13-a665e5094012 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.645610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff5a41-c6cb-4a45-ab13-a665e5094012 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.665591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:14.703140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723198f-4352-4696-9d29-31ef9b20edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.703759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723198f-4352-4696-9d29-31ef9b20edb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.704021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723198f-4352-4696-9d29-31ef9b20edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.704296 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723198f-4352-4696-9d29-31ef9b20edb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.704927 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723198f-4352-4696-9d29-31ef9b20edb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.706507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723198f-4352-4696-9d29-31ef9b20edb1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.716589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1370/2712] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:14.720700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ce07-4b04-4570-955d-f78d7bb114a4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.726132 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:14.732688 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23ce07-4b04-4570-955d-f78d7bb114a4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.737679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.738325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.738608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.738888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] PATH_INFO: `/v3/projects/596ff53b817345b5b7892b273030c734/users/2932e54f11414b0499082b41a648639e/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.740839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596ff53b817345b5b7892b273030c734, user_id=2932e54f11414b0499082b41a648639e, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.744012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.753984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1343/2713] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:14 2022] PUT /identity/v3/projects/596ff53b817345b5b7892b273030c734/users/2932e54f11414b0499082b41a648639e/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:14.764691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3197da-e199-458a-9df3-da5cb3d3b351 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.765168 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3197da-e199-458a-9df3-da5cb3d3b351 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.765283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3197da-e199-458a-9df3-da5cb3d3b351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.792765 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5b3197da-e199-458a-9df3-da5cb3d3b351 None None] MFA Rules not processed for user `2932e54f11414b0499082b41a648639e`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:14.793975 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5b3197da-e199-458a-9df3-da5cb3d3b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.859909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1371/2714] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:14.871625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:14.873349 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:14.929962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3918806-06de-450e-9890-71f6aaf93a17 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:14.934120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970afeb-2f00-4b16-b812-3392fd7f676c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:14.934717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970afeb-2f00-4b16-b812-3392fd7f676c service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:14.935012 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970afeb-2f00-4b16-b812-3392fd7f676c service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:14.935310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970afeb-2f00-4b16-b812-3392fd7f676c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:14.944235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970afeb-2f00-4b16-b812-3392fd7f676c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:14.945646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970afeb-2f00-4b16-b812-3392fd7f676c service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:14.955577 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1344/2715] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:15.000018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3197da-e199-458a-9df3-da5cb3d3b351 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:15.001428 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5b3197da-e199-458a-9df3-da5cb3d3b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:15.013508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3197da-e199-458a-9df3-da5cb3d3b351 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:15.017120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc654-e5a1-48fc-a9f4-b7c8aa16e658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:15.017718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc654-e5a1-48fc-a9f4-b7c8aa16e658 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:15.017994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc654-e5a1-48fc-a9f4-b7c8aa16e658 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:15.018267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc654-e5a1-48fc-a9f4-b7c8aa16e658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:15.073995 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc654-e5a1-48fc-a9f4-b7c8aa16e658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:15.075452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc654-e5a1-48fc-a9f4-b7c8aa16e658 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:15.084384 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1372/2716] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:18.373086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970afeb-2f00-4b16-b812-3392fd7f676c service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.434280 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970afeb-2f00-4b16-b812-3392fd7f676c service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.438679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.439344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.439622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.439924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] PATH_INFO: `/v3/users/8a2f733fb7ce47d387a6b8a36806e18b` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.441031 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2f733fb7ce47d387a6b8a36806e18b)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.442913 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.489617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2f733fb7ce47d387a6b8a36806e18b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.496502 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2f733fb7ce47d387a6b8a36806e18b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.497135 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2f733fb7ce47d387a6b8a36806e18b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.497743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2f733fb7ce47d387a6b8a36806e18b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.504646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2f733fb7ce47d387a6b8a36806e18b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:18.521450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1345/2717] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:18 2022] DELETE /identity/v3/users/8a2f733fb7ce47d387a6b8a36806e18b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:18.526382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b887-f389-4c33-99d5-6f926a94d2d8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.526875 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b887-f389-4c33-99d5-6f926a94d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.526987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b887-f389-4c33-99d5-6f926a94d2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.546264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-12e1b887-f389-4c33-99d5-6f926a94d2d8 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:18.547497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-12e1b887-f389-4c33-99d5-6f926a94d2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.586842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=100 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:18.607044 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1373/2718] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:18.616810 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.618230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.632516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:18.678313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b614b1-2aae-4ba8-81d9-187f6644a2a5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.682570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bb438-792e-46cb-b12a-d0fdba37ad4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.683282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bb438-792e-46cb-b12a-d0fdba37ad4c service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.683558 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bb438-792e-46cb-b12a-d0fdba37ad4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.683830 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07bb438-792e-46cb-b12a-d0fdba37ad4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.693843 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bb438-792e-46cb-b12a-d0fdba37ad4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.695283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07bb438-792e-46cb-b12a-d0fdba37ad4c service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:18.705487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1346/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:18.966077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b887-f389-4c33-99d5-6f926a94d2d8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:18.967581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-12e1b887-f389-4c33-99d5-6f926a94d2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:18.980923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b887-f389-4c33-99d5-6f926a94d2d8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:18.985526 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:18.986163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:18.986442 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:18.986713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] PATH_INFO: `/v3/projects/ddc1c1b0f8fd49f2a546beb91a02466b` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:18.987865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc1c1b0f8fd49f2a546beb91a02466b)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:18.989800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.035845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc1c1b0f8fd49f2a546beb91a02466b', 'request_id': 'req-9f2ca105-b59d-4697-a0f5-94371bda3648'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.042435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc1c1b0f8fd49f2a546beb91a02466b', 'request_id': 'req-9f2ca105-b59d-4697-a0f5-94371bda3648'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.049410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc1c1b0f8fd49f2a546beb91a02466b', 'request_id': 'req-9f2ca105-b59d-4697-a0f5-94371bda3648'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.060390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] The token cache is being invalidate because project ddc1c1b0f8fd49f2a546beb91a02466b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:19.060674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.061283 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.062745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1374/2720] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:18 2022] DELETE /identity/v3/projects/ddc1c1b0f8fd49f2a546beb91a02466b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:19.066687 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bb438-792e-46cb-b12a-d0fdba37ad4c service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.076532 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07bb438-792e-46cb-b12a-d0fdba37ad4c service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.133890 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.134639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.134924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.135229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] PATH_INFO: `/v3/users/2932e54f11414b0499082b41a648639e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.136328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2932e54f11414b0499082b41a648639e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.138249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.183235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2932e54f11414b0499082b41a648639e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.190783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2932e54f11414b0499082b41a648639e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.191453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2932e54f11414b0499082b41a648639e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.192058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2932e54f11414b0499082b41a648639e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.199922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-463fa3de-5065-48d2-8946-8083022dc6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2932e54f11414b0499082b41a648639e'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.216966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1347/2721] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:19 2022] DELETE /identity/v3/users/2932e54f11414b0499082b41a648639e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:19.486266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.487788 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:19.503931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca105-b59d-4697-a0f5-94371bda3648 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.562890 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.563596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.563817 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.564087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] PATH_INFO: `/v3/projects/596ff53b817345b5b7892b273030c734` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.565222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=596ff53b817345b5b7892b273030c734)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.567171 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.612789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596ff53b817345b5b7892b273030c734', 'request_id': 'req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.618754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596ff53b817345b5b7892b273030c734', 'request_id': 'req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.625818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596ff53b817345b5b7892b273030c734', 'request_id': 'req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.632102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:19.637793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] The token cache is being invalidate because project 596ff53b817345b5b7892b273030c734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:19.638141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.639038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-d8b4aede-74db-4246-b0cb-d5f1b0a8f30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:19.640781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1375/2722] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:19 2022] DELETE /identity/v3/projects/596ff53b817345b5b7892b273030c734 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:19.645666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078f3c-82e8-43f4-a49c-768a10fa635e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.646124 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078f3c-82e8-43f4-a49c-768a10fa635e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.646220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078f3c-82e8-43f4-a49c-768a10fa635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.666463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2b078f3c-82e8-43f4-a49c-768a10fa635e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:19.667704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2b078f3c-82e8-43f4-a49c-768a10fa635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:19.696923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:19.728879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1348/2723] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:19.736507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4919b-0db9-4e4e-bfcf-2927961dc0e9 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.736786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4919b-0db9-4e4e-bfcf-2927961dc0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.737056 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4919b-0db9-4e4e-bfcf-2927961dc0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.756643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-59c4919b-0db9-4e4e-bfcf-2927961dc0e9 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:19.757823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-59c4919b-0db9-4e4e-bfcf-2927961dc0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:19.765607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1376/2724] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:19.769717 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078f3c-82e8-43f4-a49c-768a10fa635e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.779752 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078f3c-82e8-43f4-a49c-768a10fa635e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.784243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.784833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.785109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.785383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.786018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:19.786352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.787942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.799991 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1349/2725] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:28:19.804164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4919b-0db9-4e4e-bfcf-2927961dc0e9 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.814065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4919b-0db9-4e4e-bfcf-2927961dc0e9 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.818667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5014-22c8-4ead-84ab-bce19357479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.819324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5014-22c8-4ead-84ab-bce19357479d admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.819606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5014-22c8-4ead-84ab-bce19357479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.819880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5014-22c8-4ead-84ab-bce19357479d admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.820507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd5014-22c8-4ead-84ab-bce19357479d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.822417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd5014-22c8-4ead-84ab-bce19357479d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.849387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1377/2726] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:19.853995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.863723 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350848ef-45ae-48d2-bcab-58501627dbce admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.919129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527350a-1b52-44d2-9836-6d08527bba22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.919729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527350a-1b52-44d2-9836-6d08527bba22 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.920007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527350a-1b52-44d2-9836-6d08527bba22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.920278 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527350a-1b52-44d2-9836-6d08527bba22 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.920907 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527350a-1b52-44d2-9836-6d08527bba22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.922956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527350a-1b52-44d2-9836-6d08527bba22 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.943292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1350/2727] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:19 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:19.947524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5014-22c8-4ead-84ab-bce19357479d admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.957623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5014-22c8-4ead-84ab-bce19357479d admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.963075 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234a18-460c-43b9-942e-eb431cf33fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.963773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234a18-460c-43b9-942e-eb431cf33fea admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.964054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234a18-460c-43b9-942e-eb431cf33fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.964327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234a18-460c-43b9-942e-eb431cf33fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.964966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234a18-460c-43b9-942e-eb431cf33fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.966547 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234a18-460c-43b9-942e-eb431cf33fea admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:19.976359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1378/2728] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:19.981141 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527350a-1b52-44d2-9836-6d08527bba22 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:19.991241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527350a-1b52-44d2-9836-6d08527bba22 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:19.996282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7ea90-abea-454f-b3d3-784e6553510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:19.996874 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7ea90-abea-454f-b3d3-784e6553510b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:19.997155 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7ea90-abea-454f-b3d3-784e6553510b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:19.997428 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7ea90-abea-454f-b3d3-784e6553510b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:19.998060 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7ea90-abea-454f-b3d3-784e6553510b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:19.999666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7ea90-abea-454f-b3d3-784e6553510b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.010308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1351/2729] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:20.014392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234a18-460c-43b9-942e-eb431cf33fea admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:20.024297 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234a18-460c-43b9-942e-eb431cf33fea admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:20.029364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1153d50-3670-444d-9057-ba08bbb59f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:20.029998 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1153d50-3670-444d-9057-ba08bbb59f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.030277 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1153d50-3670-444d-9057-ba08bbb59f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.030550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1153d50-3670-444d-9057-ba08bbb59f1c admin admin] PATH_INFO: `/v3/projects/049253926f55482b96b21a8129745f69/users/d1f7f640d2954627a856d78c0b68a679/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.045628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1153d50-3670-444d-9057-ba08bbb59f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=049253926f55482b96b21a8129745f69, user_id=d1f7f640d2954627a856d78c0b68a679, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:20.048268 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1153d50-3670-444d-9057-ba08bbb59f1c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.061257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1379/2730] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:20 2022] PUT /identity/v3/projects/049253926f55482b96b21a8129745f69/users/d1f7f640d2954627a856d78c0b68a679/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:20.072747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917bc46-b71a-4aab-a977-856d70d7b01c None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.073034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917bc46-b71a-4aab-a977-856d70d7b01c None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.073310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917bc46-b71a-4aab-a977-856d70d7b01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.101185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4917bc46-b71a-4aab-a977-856d70d7b01c None None] MFA Rules not processed for user `d1f7f640d2954627a856d78c0b68a679`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:20.102386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4917bc46-b71a-4aab-a977-856d70d7b01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:20.169214 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1352/2731] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:20.173673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1153d50-3670-444d-9057-ba08bbb59f1c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:20.236125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1153d50-3670-444d-9057-ba08bbb59f1c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:20.240602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a436e-249f-4c4b-b245-459e3ca205e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:20.241197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a436e-249f-4c4b-b245-459e3ca205e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.241480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a436e-249f-4c4b-b245-459e3ca205e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.241753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a436e-249f-4c4b-b245-459e3ca205e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.242381 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a436e-249f-4c4b-b245-459e3ca205e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:20.244464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a436e-249f-4c4b-b245-459e3ca205e8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.270524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1380/2732] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:20 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:20.274531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917bc46-b71a-4aab-a977-856d70d7b01c None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:20.286014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917bc46-b71a-4aab-a977-856d70d7b01c None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:20.311850 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:20.344360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71173d6-5967-492e-8d71-20e731bc5bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:20.344966 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71173d6-5967-492e-8d71-20e731bc5bbd admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.345248 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71173d6-5967-492e-8d71-20e731bc5bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.345639 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71173d6-5967-492e-8d71-20e731bc5bbd admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.346283 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71173d6-5967-492e-8d71-20e731bc5bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:20.348190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71173d6-5967-492e-8d71-20e731bc5bbd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.368446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1353/2733] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:20 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:20.372661 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a436e-249f-4c4b-b245-459e3ca205e8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:20.383360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a436e-249f-4c4b-b245-459e3ca205e8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:20.388630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c9e41-082d-4ee9-a751-d899ce5bfed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:20.389231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9e41-082d-4ee9-a751-d899ce5bfed8 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.389513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9e41-082d-4ee9-a751-d899ce5bfed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.389786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9e41-082d-4ee9-a751-d899ce5bfed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.390427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c9e41-082d-4ee9-a751-d899ce5bfed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:20.392040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c9e41-082d-4ee9-a751-d899ce5bfed8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.402499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1381/2734] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:20.406466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71173d6-5967-492e-8d71-20e731bc5bbd admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:20.416932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71173d6-5967-492e-8d71-20e731bc5bbd admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:20.421932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b538-4957-4d35-9ed2-c86d9c9ba34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:20.422573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b538-4957-4d35-9ed2-c86d9c9ba34d admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.422855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b538-4957-4d35-9ed2-c86d9c9ba34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.423171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12b538-4957-4d35-9ed2-c86d9c9ba34d admin admin] PATH_INFO: `/v3/projects/cccc1079e4f6455aba678908801fc439/users/645175785e324558ae0584f112fccf4d/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.439233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12b538-4957-4d35-9ed2-c86d9c9ba34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccc1079e4f6455aba678908801fc439, user_id=645175785e324558ae0584f112fccf4d, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:20.441872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12b538-4957-4d35-9ed2-c86d9c9ba34d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.454725 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1354/2735] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:20 2022] PUT /identity/v3/projects/cccc1079e4f6455aba678908801fc439/users/645175785e324558ae0584f112fccf4d/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:20.458957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c9e41-082d-4ee9-a751-d899ce5bfed8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:20.469125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c9e41-082d-4ee9-a751-d899ce5bfed8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:20.524750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581d48e-2299-4acd-8d54-02c917e2afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:20.525517 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d48e-2299-4acd-8d54-02c917e2afab admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.525797 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d48e-2299-4acd-8d54-02c917e2afab admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.526071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581d48e-2299-4acd-8d54-02c917e2afab admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.526702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581d48e-2299-4acd-8d54-02c917e2afab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:20.528314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581d48e-2299-4acd-8d54-02c917e2afab admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.537803 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1382/2736] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:20.542706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b538-4957-4d35-9ed2-c86d9c9ba34d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:20.552964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12b538-4957-4d35-9ed2-c86d9c9ba34d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:20.558743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:20.559422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.559701 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.559975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] PATH_INFO: `/v3/projects/cccc1079e4f6455aba678908801fc439/users/645175785e324558ae0584f112fccf4d/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.561922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccc1079e4f6455aba678908801fc439, user_id=645175785e324558ae0584f112fccf4d, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:20.564589 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.575094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1355/2737] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:20 2022] PUT /identity/v3/projects/cccc1079e4f6455aba678908801fc439/users/645175785e324558ae0584f112fccf4d/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:20.585164 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3db6-1496-4c87-9734-31b997596826 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.585645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3db6-1496-4c87-9734-31b997596826 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.585754 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf3db6-1496-4c87-9734-31b997596826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.594719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:20.615642 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7faf3db6-1496-4c87-9734-31b997596826 None None] MFA Rules not processed for user `645175785e324558ae0584f112fccf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:20.616829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7faf3db6-1496-4c87-9734-31b997596826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:20.683643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1383/2738] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:20.694483 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:20.696230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:20.753364 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08b2d-55e1-44a8-b11b-00b94d4d1bc0 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:20.756949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ae0fd-ca0e-42ae-83ff-596580e4c62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:20.757543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae0fd-ca0e-42ae-83ff-596580e4c62a service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:20.757825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae0fd-ca0e-42ae-83ff-596580e4c62a service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:20.758098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ae0fd-ca0e-42ae-83ff-596580e4c62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:20.767103 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae0fd-ca0e-42ae-83ff-596580e4c62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:20.768513 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ae0fd-ca0e-42ae-83ff-596580e4c62a service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:20.778387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1356/2739] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:21.312921 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf3db6-1496-4c87-9734-31b997596826 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:21.377891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf3db6-1496-4c87-9734-31b997596826 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:21.382562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:21.383222 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:21.383507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:21.383781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] PATH_INFO: `/v3/users/d1f7f640d2954627a856d78c0b68a679` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:21.385177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f7f640d2954627a856d78c0b68a679)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:21.387058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:21.432885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f7f640d2954627a856d78c0b68a679'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:21.440854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f7f640d2954627a856d78c0b68a679'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:21.441477 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f7f640d2954627a856d78c0b68a679'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:21.442401 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f7f640d2954627a856d78c0b68a679'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:21.454144 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f7f640d2954627a856d78c0b68a679'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:21.466915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1384/2740] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:21 2022] DELETE /identity/v3/users/d1f7f640d2954627a856d78c0b68a679 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:21.471566 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209433e-0f09-4a7b-8717-34436c4e1bb5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:21.471857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209433e-0f09-4a7b-8717-34436c4e1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:21.472141 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209433e-0f09-4a7b-8717-34436c4e1bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:21.492822 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-8209433e-0f09-4a7b-8717-34436c4e1bb5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:21.494117 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8209433e-0f09-4a7b-8717-34436c4e1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:21.552190 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1357/2741] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:21.562083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:21.563502 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:21.574673 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:21.623823 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29921bb9-f90a-476a-a79c-de085fe31b81 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:21.627478 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb824f1-9cda-4fa6-a86b-103bdc4c6cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:21.628081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb824f1-9cda-4fa6-a86b-103bdc4c6cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:21.628361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb824f1-9cda-4fa6-a86b-103bdc4c6cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:21.628634 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb824f1-9cda-4fa6-a86b-103bdc4c6cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:21.638070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb824f1-9cda-4fa6-a86b-103bdc4c6cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:21.639530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb824f1-9cda-4fa6-a86b-103bdc4c6cb6 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:21.648787 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1385/2742] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:21.918326 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209433e-0f09-4a7b-8717-34436c4e1bb5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:21.919831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8209433e-0f09-4a7b-8717-34436c4e1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:21.931974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209433e-0f09-4a7b-8717-34436c4e1bb5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:21.936575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:21.937207 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:21.937487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:21.937833 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] PATH_INFO: `/v3/projects/049253926f55482b96b21a8129745f69` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:21.938916 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049253926f55482b96b21a8129745f69)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:21.940852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:21.963211 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:21.991878 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049253926f55482b96b21a8129745f69', 'request_id': 'req-1998781a-3061-41a9-8dea-b999528a1f92'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:21.998553 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049253926f55482b96b21a8129745f69', 'request_id': 'req-1998781a-3061-41a9-8dea-b999528a1f92'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.005745 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049253926f55482b96b21a8129745f69', 'request_id': 'req-1998781a-3061-41a9-8dea-b999528a1f92'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.016700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] The token cache is being invalidate because project 049253926f55482b96b21a8129745f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:22.016992 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.017631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.019131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1358/2743] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:21 2022] DELETE /identity/v3/projects/049253926f55482b96b21a8129745f69 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:22.023094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb824f1-9cda-4fa6-a86b-103bdc4c6cb6 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.033227 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb824f1-9cda-4fa6-a86b-103bdc4c6cb6 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.089019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.089640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.089922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.090194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] PATH_INFO: `/v3/users/645175785e324558ae0584f112fccf4d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.091391 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=645175785e324558ae0584f112fccf4d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:22.093224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:22.138496 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645175785e324558ae0584f112fccf4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.146093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645175785e324558ae0584f112fccf4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.146704 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645175785e324558ae0584f112fccf4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.147324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645175785e324558ae0584f112fccf4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.159597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-40b00632-c406-4ae2-8fa9-963a9e58a37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645175785e324558ae0584f112fccf4d'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.171609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1386/2744] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:22 2022] DELETE /identity/v3/users/645175785e324558ae0584f112fccf4d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:22.439440 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.441038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:22.455271 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998781a-3061-41a9-8dea-b999528a1f92 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.513476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.514224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.514507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.514781 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] PATH_INFO: `/v3/projects/cccc1079e4f6455aba678908801fc439` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.515934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccc1079e4f6455aba678908801fc439)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:22.517828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:22.563749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccc1079e4f6455aba678908801fc439', 'request_id': 'req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.569709 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccc1079e4f6455aba678908801fc439', 'request_id': 'req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.577443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccc1079e4f6455aba678908801fc439', 'request_id': 'req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.588756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] The token cache is being invalidate because project cccc1079e4f6455aba678908801fc439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:22.589044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.589774 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f2d7f63f-5e99-4aa0-9c4d-738e34b40ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:22.591309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1359/2745] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:22 2022] DELETE /identity/v3/projects/cccc1079e4f6455aba678908801fc439 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:22.596737 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ccd0-0f39-471e-861f-8368d3225cc3 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.597031 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ccd0-0f39-471e-861f-8368d3225cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.597307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8ccd0-0f39-471e-861f-8368d3225cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.617096 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-5bd8ccd0-0f39-471e-861f-8368d3225cc3 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:22.618324 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-5bd8ccd0-0f39-471e-861f-8368d3225cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:22.643640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:22.677791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1387/2746] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:28:22.686422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339394a-33a9-4eff-a87b-aca0859a8883 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.686705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339394a-33a9-4eff-a87b-aca0859a8883 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.687038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339394a-33a9-4eff-a87b-aca0859a8883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.707101 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9339394a-33a9-4eff-a87b-aca0859a8883 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:22.708306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9339394a-33a9-4eff-a87b-aca0859a8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:22.717263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1360/2747] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:22.721159 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ccd0-0f39-471e-861f-8368d3225cc3 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.730746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8ccd0-0f39-471e-861f-8368d3225cc3 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.735310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.735905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.736182 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.736455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.737095 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:22.737424 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:22.739018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:22.750905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1388/2748] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:22.755130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339394a-33a9-4eff-a87b-aca0859a8883 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.764945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339394a-33a9-4eff-a87b-aca0859a8883 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.769569 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92d58-cb28-4470-bbd3-9208b4284e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.770159 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92d58-cb28-4470-bbd3-9208b4284e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.770443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92d58-cb28-4470-bbd3-9208b4284e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.770720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92d58-cb28-4470-bbd3-9208b4284e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.771381 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e92d58-cb28-4470-bbd3-9208b4284e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:22.773296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e92d58-cb28-4470-bbd3-9208b4284e62 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:22.804375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:22.815230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1361/2749] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:22 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:22.816346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.826336 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca4aa4-0c4b-4c29-9f11-bc92a4d8c065 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.881376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5d64-32df-438b-a453-f212838a4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.881892 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5d64-32df-438b-a453-f212838a4ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.882170 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5d64-32df-438b-a453-f212838a4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.882441 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f5d64-32df-438b-a453-f212838a4ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.883092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f5d64-32df-438b-a453-f212838a4ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:22.885766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f5d64-32df-438b-a453-f212838a4ab5 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:22.905507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1389/2750] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:22 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:22.909578 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92d58-cb28-4470-bbd3-9208b4284e62 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.919816 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92d58-cb28-4470-bbd3-9208b4284e62 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.924518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a4926-9565-4318-8093-fbac354ec6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.925120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a4926-9565-4318-8093-fbac354ec6ef admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.925431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a4926-9565-4318-8093-fbac354ec6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.925710 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a4926-9565-4318-8093-fbac354ec6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.926357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a4926-9565-4318-8093-fbac354ec6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:22.927974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a4926-9565-4318-8093-fbac354ec6ef admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:22.938613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1362/2751] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:22.942403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5d64-32df-438b-a453-f212838a4ab5 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.952768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f5d64-32df-438b-a453-f212838a4ab5 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.957376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e3618-744b-4dd5-9d5a-db72dc6db45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.957965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e3618-744b-4dd5-9d5a-db72dc6db45d admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.958247 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e3618-744b-4dd5-9d5a-db72dc6db45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.958523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e3618-744b-4dd5-9d5a-db72dc6db45d admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:22.959463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e3618-744b-4dd5-9d5a-db72dc6db45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:22.961036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e3618-744b-4dd5-9d5a-db72dc6db45d admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:22.971455 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1390/2752] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:22.975300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a4926-9565-4318-8093-fbac354ec6ef admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:22.985447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a4926-9565-4318-8093-fbac354ec6ef admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:22.990061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c711203-4dc7-442a-bf4b-86e8ba5597e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:22.990702 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711203-4dc7-442a-bf4b-86e8ba5597e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:22.990982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711203-4dc7-442a-bf4b-86e8ba5597e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:22.991286 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711203-4dc7-442a-bf4b-86e8ba5597e3 admin admin] PATH_INFO: `/v3/projects/e23005dafed84bb1934ddf09b5e6a593/users/d6977510f5ce4e638935b3f222dd5fbd/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.006975 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c711203-4dc7-442a-bf4b-86e8ba5597e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23005dafed84bb1934ddf09b5e6a593, user_id=d6977510f5ce4e638935b3f222dd5fbd, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.010646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c711203-4dc7-442a-bf4b-86e8ba5597e3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.023179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1363/2753] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:22 2022] PUT /identity/v3/projects/e23005dafed84bb1934ddf09b5e6a593/users/d6977510f5ce4e638935b3f222dd5fbd/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:23.033508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520af27f-da7d-487f-b93d-2d7c6168392a None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.033793 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520af27f-da7d-487f-b93d-2d7c6168392a None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.034067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520af27f-da7d-487f-b93d-2d7c6168392a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.061717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-520af27f-da7d-487f-b93d-2d7c6168392a None None] MFA Rules not processed for user `d6977510f5ce4e638935b3f222dd5fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:23.062922 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-520af27f-da7d-487f-b93d-2d7c6168392a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:23.128860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1391/2754] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:23.133560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c711203-4dc7-442a-bf4b-86e8ba5597e3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:23.195681 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c711203-4dc7-442a-bf4b-86e8ba5597e3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:23.200918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c98f7-e62a-460e-8d3f-66263405efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:23.201515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c98f7-e62a-460e-8d3f-66263405efb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.201796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c98f7-e62a-460e-8d3f-66263405efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.202083 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c98f7-e62a-460e-8d3f-66263405efb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.202703 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c98f7-e62a-460e-8d3f-66263405efb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.204631 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c98f7-e62a-460e-8d3f-66263405efb1 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.230632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1364/2755] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:23 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:23.234768 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520af27f-da7d-487f-b93d-2d7c6168392a None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:23.246093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520af27f-da7d-487f-b93d-2d7c6168392a None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:23.269795 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:23.302445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70909f85-2dd0-4db1-ba6d-be2706bd36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:23.303078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70909f85-2dd0-4db1-ba6d-be2706bd36f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.303363 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70909f85-2dd0-4db1-ba6d-be2706bd36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.303638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70909f85-2dd0-4db1-ba6d-be2706bd36f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.304271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70909f85-2dd0-4db1-ba6d-be2706bd36f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.306851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70909f85-2dd0-4db1-ba6d-be2706bd36f9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.327250 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1392/2756] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:23 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:23.331375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c98f7-e62a-460e-8d3f-66263405efb1 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:23.342013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c98f7-e62a-460e-8d3f-66263405efb1 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:23.346619 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f2e7-7d3f-42a8-913d-54b222665e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:23.347225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f2e7-7d3f-42a8-913d-54b222665e84 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.347503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f2e7-7d3f-42a8-913d-54b222665e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.347775 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309f2e7-7d3f-42a8-913d-54b222665e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.348404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309f2e7-7d3f-42a8-913d-54b222665e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.349962 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309f2e7-7d3f-42a8-913d-54b222665e84 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.361088 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1365/2757] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:23.365062 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70909f85-2dd0-4db1-ba6d-be2706bd36f9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:23.375551 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70909f85-2dd0-4db1-ba6d-be2706bd36f9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:23.380088 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040025-4e8c-4753-9eba-bbafb68561af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:23.380733 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040025-4e8c-4753-9eba-bbafb68561af admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.381013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040025-4e8c-4753-9eba-bbafb68561af admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.381289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040025-4e8c-4753-9eba-bbafb68561af admin admin] PATH_INFO: `/v3/projects/ad62e2c937a44a8d94860355f6c759a9/users/e893d79e575941a0a59433831dcf0cba/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.397166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd040025-4e8c-4753-9eba-bbafb68561af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad62e2c937a44a8d94860355f6c759a9, user_id=e893d79e575941a0a59433831dcf0cba, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.399860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd040025-4e8c-4753-9eba-bbafb68561af admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.412201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1393/2758] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:23 2022] PUT /identity/v3/projects/ad62e2c937a44a8d94860355f6c759a9/users/e893d79e575941a0a59433831dcf0cba/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:23.416656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f2e7-7d3f-42a8-913d-54b222665e84 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:23.426594 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309f2e7-7d3f-42a8-913d-54b222665e84 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:23.482866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08e369c-5f11-4ba8-99a8-d18bd464e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:23.483504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e369c-5f11-4ba8-99a8-d18bd464e214 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.483788 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e369c-5f11-4ba8-99a8-d18bd464e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.484066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e369c-5f11-4ba8-99a8-d18bd464e214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.484700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e369c-5f11-4ba8-99a8-d18bd464e214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.486272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08e369c-5f11-4ba8-99a8-d18bd464e214 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.495908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1366/2759] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:23.500300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040025-4e8c-4753-9eba-bbafb68561af admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:23.511410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd040025-4e8c-4753-9eba-bbafb68561af admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:23.516037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:23.516676 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.516955 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.517228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] PATH_INFO: `/v3/projects/ad62e2c937a44a8d94860355f6c759a9/users/e893d79e575941a0a59433831dcf0cba/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.519160 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad62e2c937a44a8d94860355f6c759a9, user_id=e893d79e575941a0a59433831dcf0cba, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.521740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.531901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1394/2760] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:23 2022] PUT /identity/v3/projects/ad62e2c937a44a8d94860355f6c759a9/users/e893d79e575941a0a59433831dcf0cba/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:28:23.542620 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ac39-61f9-49a3-947b-08e520a56c63 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.542910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ac39-61f9-49a3-947b-08e520a56c63 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.543809 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ac39-61f9-49a3-947b-08e520a56c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.572827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5da7ac39-61f9-49a3-947b-08e520a56c63 None None] MFA Rules not processed for user `e893d79e575941a0a59433831dcf0cba`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:23.574040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5da7ac39-61f9-49a3-947b-08e520a56c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:23.598541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:23.644854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1367/2761] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:23.656860 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:23.658674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:23.715861 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcab63-c43f-4331-ac20-73f97058acab admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:23.719596 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa03c-f526-4b5a-973a-c816fc0e49e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:23.720192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa03c-f526-4b5a-973a-c816fc0e49e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.720471 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa03c-f526-4b5a-973a-c816fc0e49e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.720745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa03c-f526-4b5a-973a-c816fc0e49e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.730517 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa03c-f526-4b5a-973a-c816fc0e49e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.732000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa03c-f526-4b5a-973a-c816fc0e49e3 service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.741488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1395/2762] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:23.816855 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ac39-61f9-49a3-947b-08e520a56c63 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:23.826556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ac39-61f9-49a3-947b-08e520a56c63 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:23.830139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceea582-e2cf-46ae-b0d9-93ea74415153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:23.830711 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea582-e2cf-46ae-b0d9-93ea74415153 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:23.830986 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea582-e2cf-46ae-b0d9-93ea74415153 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:23.831285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceea582-e2cf-46ae-b0d9-93ea74415153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:23.887840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceea582-e2cf-46ae-b0d9-93ea74415153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:23.889257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceea582-e2cf-46ae-b0d9-93ea74415153 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:23.898118 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1368/2763] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:24.173111 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa03c-f526-4b5a-973a-c816fc0e49e3 service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:24.235623 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa03c-f526-4b5a-973a-c816fc0e49e3 service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:24.240174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:24.240796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:24.241076 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:24.241349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] PATH_INFO: `/v3/users/d6977510f5ce4e638935b3f222dd5fbd` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:24.242452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6977510f5ce4e638935b3f222dd5fbd)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:24.245175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:24.266852 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:24.292192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6977510f5ce4e638935b3f222dd5fbd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.299313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6977510f5ce4e638935b3f222dd5fbd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.299957 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6977510f5ce4e638935b3f222dd5fbd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.300567 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6977510f5ce4e638935b3f222dd5fbd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.313175 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6977510f5ce4e638935b3f222dd5fbd'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.325377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1396/2764] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:24 2022] DELETE /identity/v3/users/d6977510f5ce4e638935b3f222dd5fbd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:24.329973 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5928f53-2af6-4498-a226-523ea53fd354 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:24.330431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5928f53-2af6-4498-a226-523ea53fd354 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:24.330528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5928f53-2af6-4498-a226-523ea53fd354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:24.350240 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d5928f53-2af6-4498-a226-523ea53fd354 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:24.351459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d5928f53-2af6-4498-a226-523ea53fd354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:24.409202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1369/2765] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:24.419580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:24.421133 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:24.478947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62731908-9115-428b-a65f-223eb2a222fd admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:24.482614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051722a-da1a-4c63-813b-087525fcb19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:24.483252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051722a-da1a-4c63-813b-087525fcb19e service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:24.483533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051722a-da1a-4c63-813b-087525fcb19e service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:24.483807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051722a-da1a-4c63-813b-087525fcb19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:24.492872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051722a-da1a-4c63-813b-087525fcb19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:24.494553 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051722a-da1a-4c63-813b-087525fcb19e service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:24.504150 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1397/2766] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:24.766913 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5928f53-2af6-4498-a226-523ea53fd354 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:24.768441 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d5928f53-2af6-4498-a226-523ea53fd354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:24.786640 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5928f53-2af6-4498-a226-523ea53fd354 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:24.793515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:24.794164 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:24.794579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:24.794960 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] PATH_INFO: `/v3/projects/e23005dafed84bb1934ddf09b5e6a593` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:24.796376 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23005dafed84bb1934ddf09b5e6a593)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:24.798845 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:24.844925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23005dafed84bb1934ddf09b5e6a593', 'request_id': 'req-f93c358c-7ad2-48f4-8cf6-079c4878edfe'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.850967 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23005dafed84bb1934ddf09b5e6a593', 'request_id': 'req-f93c358c-7ad2-48f4-8cf6-079c4878edfe'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.853140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:24.859550 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23005dafed84bb1934ddf09b5e6a593', 'request_id': 'req-f93c358c-7ad2-48f4-8cf6-079c4878edfe'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.870607 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] The token cache is being invalidate because project e23005dafed84bb1934ddf09b5e6a593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:24.870897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.871555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.873033 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1370/2767] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:24 2022] DELETE /identity/v3/projects/e23005dafed84bb1934ddf09b5e6a593 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:24.877054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051722a-da1a-4c63-813b-087525fcb19e service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:24.887067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051722a-da1a-4c63-813b-087525fcb19e service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:24.941093 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:24.941760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:24.941984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:24.942253 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] PATH_INFO: `/v3/users/e893d79e575941a0a59433831dcf0cba` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:24.943390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e893d79e575941a0a59433831dcf0cba)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:24.945279 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:24.990225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:24.991894 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e893d79e575941a0a59433831dcf0cba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:24.999780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e893d79e575941a0a59433831dcf0cba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.000439 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e893d79e575941a0a59433831dcf0cba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.001293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e893d79e575941a0a59433831dcf0cba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.014582 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ff3e4a78-5ffc-4c64-9a0b-e873374628e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e893d79e575941a0a59433831dcf0cba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.028506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1398/2768] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:24 2022] DELETE /identity/v3/users/e893d79e575941a0a59433831dcf0cba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:25.297460 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:25.299719 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:25.314716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c358c-7ad2-48f4-8cf6-079c4878edfe admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:25.374013 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:25.374647 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.374909 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.375221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] PATH_INFO: `/v3/projects/ad62e2c937a44a8d94860355f6c759a9` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.376301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad62e2c937a44a8d94860355f6c759a9)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:25.378168 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:25.425221 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad62e2c937a44a8d94860355f6c759a9', 'request_id': 'req-354698dc-0ba3-47a0-b1be-d006e2b4470b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.431662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad62e2c937a44a8d94860355f6c759a9', 'request_id': 'req-354698dc-0ba3-47a0-b1be-d006e2b4470b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.444420 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad62e2c937a44a8d94860355f6c759a9', 'request_id': 'req-354698dc-0ba3-47a0-b1be-d006e2b4470b'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.455606 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] The token cache is being invalidate because project ad62e2c937a44a8d94860355f6c759a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:25.455894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.456514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-354698dc-0ba3-47a0-b1be-d006e2b4470b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:25.457974 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1371/2769] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:25 2022] DELETE /identity/v3/projects/ad62e2c937a44a8d94860355f6c759a9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:25.464944 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989d95f-86fc-41d4-bd2d-db0c0bb45d86 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.465231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989d95f-86fc-41d4-bd2d-db0c0bb45d86 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.465506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989d95f-86fc-41d4-bd2d-db0c0bb45d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.484710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-1989d95f-86fc-41d4-bd2d-db0c0bb45d86 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:25.485844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-1989d95f-86fc-41d4-bd2d-db0c0bb45d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:25.544396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1399/2770] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:25.608320 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262868e7-a289-4d2e-b5fe-9ef6c75a3530 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.608600 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262868e7-a289-4d2e-b5fe-9ef6c75a3530 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.608899 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262868e7-a289-4d2e-b5fe-9ef6c75a3530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.628953 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-262868e7-a289-4d2e-b5fe-9ef6c75a3530 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:25.630153 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-262868e7-a289-4d2e-b5fe-9ef6c75a3530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:25.638872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1372/2771] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:25.643043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989d95f-86fc-41d4-bd2d-db0c0bb45d86 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:25.653176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989d95f-86fc-41d4-bd2d-db0c0bb45d86 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:25.657626 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:25.658216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.658495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.658764 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.659446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:28:25.659745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:25.661315 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:25.672635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1400/2772] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:28:25.677063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262868e7-a289-4d2e-b5fe-9ef6c75a3530 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:25.686185 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262868e7-a289-4d2e-b5fe-9ef6c75a3530 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:25.690805 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfb751-248c-409c-99c7-fd2cecd595f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:25.691431 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfb751-248c-409c-99c7-fd2cecd595f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.691715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfb751-248c-409c-99c7-fd2cecd595f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.691992 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfb751-248c-409c-99c7-fd2cecd595f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.692624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfb751-248c-409c-99c7-fd2cecd595f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:25.694504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfb751-248c-409c-99c7-fd2cecd595f4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:25.722581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1373/2773] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:25 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:25.726611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:25.736732 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869edba-d6a6-4de7-9ba7-a584402f28bc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:25.792856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e7f5-6382-4b4a-9284-0302a90b61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:25.793464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e7f5-6382-4b4a-9284-0302a90b61ff admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.793744 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e7f5-6382-4b4a-9284-0302a90b61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.794020 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e7f5-6382-4b4a-9284-0302a90b61ff admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.794655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3e7f5-6382-4b4a-9284-0302a90b61ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:25.796602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3e7f5-6382-4b4a-9284-0302a90b61ff admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:25.817105 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1401/2774] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:25 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:25.821964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfb751-248c-409c-99c7-fd2cecd595f4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:25.832442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfb751-248c-409c-99c7-fd2cecd595f4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:25.837476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50193cc7-03a1-460e-a26c-70f729ced19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:25.838072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50193cc7-03a1-460e-a26c-70f729ced19b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.838358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50193cc7-03a1-460e-a26c-70f729ced19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.838636 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50193cc7-03a1-460e-a26c-70f729ced19b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.839314 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50193cc7-03a1-460e-a26c-70f729ced19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:25.840898 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50193cc7-03a1-460e-a26c-70f729ced19b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:25.850911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1374/2775] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:25.854683 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e7f5-6382-4b4a-9284-0302a90b61ff admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:25.864411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e7f5-6382-4b4a-9284-0302a90b61ff admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:25.869495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3fa1c-448a-4d81-add0-4aaf17bf4d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:25.870072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3fa1c-448a-4d81-add0-4aaf17bf4d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.870348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3fa1c-448a-4d81-add0-4aaf17bf4d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.870621 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3fa1c-448a-4d81-add0-4aaf17bf4d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.871294 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3fa1c-448a-4d81-add0-4aaf17bf4d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:25.872863 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c3fa1c-448a-4d81-add0-4aaf17bf4d46 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:25.883174 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1402/2776] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:25.887341 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50193cc7-03a1-460e-a26c-70f729ced19b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:25.897334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50193cc7-03a1-460e-a26c-70f729ced19b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:25.902376 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22a62a-f762-4cac-a24a-b76dc1e03e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:25.903029 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a62a-f762-4cac-a24a-b76dc1e03e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.903313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a62a-f762-4cac-a24a-b76dc1e03e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.903587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22a62a-f762-4cac-a24a-b76dc1e03e55 admin admin] PATH_INFO: `/v3/projects/c9d4b2ae684642ac80784bd2125b75f9/users/c3725ab079674520adfd2cc8b6efd381/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.918584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22a62a-f762-4cac-a24a-b76dc1e03e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d4b2ae684642ac80784bd2125b75f9, user_id=c3725ab079674520adfd2cc8b6efd381, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:25.921209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22a62a-f762-4cac-a24a-b76dc1e03e55 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:25.933684 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1375/2777] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:25 2022] PUT /identity/v3/projects/c9d4b2ae684642ac80784bd2125b75f9/users/c3725ab079674520adfd2cc8b6efd381/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:25.943597 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2872a-3df3-4ed7-8f99-6b20ee3d0941 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:25.943879 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2872a-3df3-4ed7-8f99-6b20ee3d0941 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:25.944179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2872a-3df3-4ed7-8f99-6b20ee3d0941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:25.972643 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-eec2872a-3df3-4ed7-8f99-6b20ee3d0941 None None] MFA Rules not processed for user `c3725ab079674520adfd2cc8b6efd381`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:25.973859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-eec2872a-3df3-4ed7-8f99-6b20ee3d0941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:25.990457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:26.039310 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1403/2778] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:26.044346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22a62a-f762-4cac-a24a-b76dc1e03e55 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:26.054079 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:26.106818 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22a62a-f762-4cac-a24a-b76dc1e03e55 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:26.111466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed27446-e919-4783-9b79-fbf8f40bd1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:26.112064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed27446-e919-4783-9b79-fbf8f40bd1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:26.112346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed27446-e919-4783-9b79-fbf8f40bd1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:26.112625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed27446-e919-4783-9b79-fbf8f40bd1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:26.113258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed27446-e919-4783-9b79-fbf8f40bd1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:26.115189 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed27446-e919-4783-9b79-fbf8f40bd1d6 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:26.140995 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1376/2779] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:28:26 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:26.145030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2872a-3df3-4ed7-8f99-6b20ee3d0941 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:26.156073 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2872a-3df3-4ed7-8f99-6b20ee3d0941 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:26.214789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd61c-5ab6-422a-8b36-72c8e5eaee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:26.215431 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd61c-5ab6-422a-8b36-72c8e5eaee9b admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:26.215706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd61c-5ab6-422a-8b36-72c8e5eaee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:26.215978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8dd61c-5ab6-422a-8b36-72c8e5eaee9b admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:26.216615 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd61c-5ab6-422a-8b36-72c8e5eaee9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:26.218519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8dd61c-5ab6-422a-8b36-72c8e5eaee9b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:26.240308 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1404/2780] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:28:26 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:28:26.244572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed27446-e919-4783-9b79-fbf8f40bd1d6 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:26.254692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed27446-e919-4783-9b79-fbf8f40bd1d6 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:26.260219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc1cfb-b924-4e67-8eb2-a2192ab39c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:26.260842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc1cfb-b924-4e67-8eb2-a2192ab39c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:26.261120 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc1cfb-b924-4e67-8eb2-a2192ab39c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:26.261396 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc1cfb-b924-4e67-8eb2-a2192ab39c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:26.262034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc1cfb-b924-4e67-8eb2-a2192ab39c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:26.263666 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc1cfb-b924-4e67-8eb2-a2192ab39c47 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:26.274094 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1377/2781] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:28:26.278674 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd61c-5ab6-422a-8b36-72c8e5eaee9b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:26.288411 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8dd61c-5ab6-422a-8b36-72c8e5eaee9b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:26.293053 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc9aea-b979-445e-a86e-7c92ff6bacb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:26.293689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9aea-b979-445e-a86e-7c92ff6bacb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:26.293965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9aea-b979-445e-a86e-7c92ff6bacb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:26.294237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc9aea-b979-445e-a86e-7c92ff6bacb3 admin admin] PATH_INFO: `/v3/projects/0cd7c67d965a4157a5729bee874e08b5/users/d6b9dc9811dd468d8171f8b1ec684bdf/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:26.309080 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc9aea-b979-445e-a86e-7c92ff6bacb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd7c67d965a4157a5729bee874e08b5, user_id=d6b9dc9811dd468d8171f8b1ec684bdf, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:26.312016 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc9aea-b979-445e-a86e-7c92ff6bacb3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:26.325040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1405/2782] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:26 2022] PUT /identity/v3/projects/0cd7c67d965a4157a5729bee874e08b5/users/d6b9dc9811dd468d8171f8b1ec684bdf/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:26.328935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc1cfb-b924-4e67-8eb2-a2192ab39c47 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:26.339828 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc1cfb-b924-4e67-8eb2-a2192ab39c47 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:26.395416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bde2f-9c30-4831-948b-7b0dfbb55f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:26.396085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bde2f-9c30-4831-948b-7b0dfbb55f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:26.396281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bde2f-9c30-4831-948b-7b0dfbb55f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:26.396555 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bde2f-9c30-4831-948b-7b0dfbb55f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:26.397183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bde2f-9c30-4831-948b-7b0dfbb55f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:26.398754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bde2f-9c30-4831-948b-7b0dfbb55f5d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:26.409059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1378/2783] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:28:26.413179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc9aea-b979-445e-a86e-7c92ff6bacb3 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:26.423663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc9aea-b979-445e-a86e-7c92ff6bacb3 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:26.428226 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:26.428869 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:26.429152 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:26.429429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] PATH_INFO: `/v3/projects/0cd7c67d965a4157a5729bee874e08b5/users/d6b9dc9811dd468d8171f8b1ec684bdf/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:26.431598 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cd7c67d965a4157a5729bee874e08b5, user_id=d6b9dc9811dd468d8171f8b1ec684bdf, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:26.434205 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:26.444879 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1406/2784] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:28:26 2022] PUT /identity/v3/projects/0cd7c67d965a4157a5729bee874e08b5/users/d6b9dc9811dd468d8171f8b1ec684bdf/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:26.455813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80161a-6b8b-4ffb-a4b4-c2f8affbfc5e None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:26.456098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80161a-6b8b-4ffb-a4b4-c2f8affbfc5e None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:26.456373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80161a-6b8b-4ffb-a4b4-c2f8affbfc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:26.484767 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-db80161a-6b8b-4ffb-a4b4-c2f8affbfc5e None None] MFA Rules not processed for user `d6b9dc9811dd468d8171f8b1ec684bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:26.485978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-db80161a-6b8b-4ffb-a4b4-c2f8affbfc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:26.553412 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1379/2785] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:26.564909 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:26.566595 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:26.625289 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c95390-70c2-43ec-87b9-19362d11cd28 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:26.629043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89be476-4807-4136-9839-93ea249902cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:26.629648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be476-4807-4136-9839-93ea249902cd service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:26.629930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be476-4807-4136-9839-93ea249902cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:26.630237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89be476-4807-4136-9839-93ea249902cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:26.654953 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:26.687912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be476-4807-4136-9839-93ea249902cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:26.689368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89be476-4807-4136-9839-93ea249902cd service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:26.698196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1407/2786] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:29.238645 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80161a-6b8b-4ffb-a4b4-c2f8affbfc5e None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:29.243950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:29.301673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80161a-6b8b-4ffb-a4b4-c2f8affbfc5e None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:29.306272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:29.306902 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:29.307277 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:29.307470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] PATH_INFO: `/v3/users/c3725ab079674520adfd2cc8b6efd381` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:29.308593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3725ab079674520adfd2cc8b6efd381)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:29.310500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:29.359650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3725ab079674520adfd2cc8b6efd381'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.366942 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3725ab079674520adfd2cc8b6efd381'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.367605 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3725ab079674520adfd2cc8b6efd381'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.368210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3725ab079674520adfd2cc8b6efd381'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.375194 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3725ab079674520adfd2cc8b6efd381'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.392857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1380/2787] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:29 2022] DELETE /identity/v3/users/c3725ab079674520adfd2cc8b6efd381 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:29.397924 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12011-c2c4-483c-8a11-2c36da752bd8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:29.398388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12011-c2c4-483c-8a11-2c36da752bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:29.398507 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b12011-c2c4-483c-8a11-2c36da752bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:29.417845 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-85b12011-c2c4-483c-8a11-2c36da752bd8 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:29.419063 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-85b12011-c2c4-483c-8a11-2c36da752bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:29.477556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1408/2788] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:29.488010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:29.489411 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:29.549292 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ba103-1901-4711-a9ea-c45a94c46ea2 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:29.552877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed106d0-557f-4190-92c5-352a1254e35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:29.553479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed106d0-557f-4190-92c5-352a1254e35b service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:29.553753 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed106d0-557f-4190-92c5-352a1254e35b service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:29.554021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed106d0-557f-4190-92c5-352a1254e35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:29.563142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed106d0-557f-4190-92c5-352a1254e35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:29.564556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed106d0-557f-4190-92c5-352a1254e35b service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:29.574025 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1381/2789] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:29.843530 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b12011-c2c4-483c-8a11-2c36da752bd8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:29.844963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-85b12011-c2c4-483c-8a11-2c36da752bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:29.857577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b12011-c2c4-483c-8a11-2c36da752bd8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:29.862206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:29.862834 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:29.863146 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:29.863416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] PATH_INFO: `/v3/projects/c9d4b2ae684642ac80784bd2125b75f9` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:29.864521 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d4b2ae684642ac80784bd2125b75f9)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:29.866406 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:29.914214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d4b2ae684642ac80784bd2125b75f9', 'request_id': 'req-a0917130-ec92-4347-98b5-280f05887b43'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.920437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d4b2ae684642ac80784bd2125b75f9', 'request_id': 'req-a0917130-ec92-4347-98b5-280f05887b43'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.927403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d4b2ae684642ac80784bd2125b75f9', 'request_id': 'req-a0917130-ec92-4347-98b5-280f05887b43'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.937571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] The token cache is being invalidate because project c9d4b2ae684642ac80784bd2125b75f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:29.937858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.938488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:29.939989 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1409/2790] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:29 2022] DELETE /identity/v3/projects/c9d4b2ae684642ac80784bd2125b75f9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:29.943982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed106d0-557f-4190-92c5-352a1254e35b service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:29.953988 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed106d0-557f-4190-92c5-352a1254e35b service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:29.977446 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:30.012675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:30.013311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:30.013596 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:30.013872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] PATH_INFO: `/v3/users/d6b9dc9811dd468d8171f8b1ec684bdf` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:30.015010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b9dc9811dd468d8171f8b1ec684bdf)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:30.016929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:30.062282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b9dc9811dd468d8171f8b1ec684bdf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.069630 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b9dc9811dd468d8171f8b1ec684bdf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.070268 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b9dc9811dd468d8171f8b1ec684bdf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.070892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b9dc9811dd468d8171f8b1ec684bdf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.079086 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b9dc9811dd468d8171f8b1ec684bdf'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.097334 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1382/2791] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:28:29 2022] DELETE /identity/v3/users/d6b9dc9811dd468d8171f8b1ec684bdf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:30.367473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:30.368917 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:30.382388 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0917130-ec92-4347-98b5-280f05887b43 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:30.428865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:30.442523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:30.443195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:30.443499 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:30.443769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] PATH_INFO: `/v3/projects/0cd7c67d965a4157a5729bee874e08b5` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:30.444878 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cd7c67d965a4157a5729bee874e08b5)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:30.446746 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:30.493246 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cd7c67d965a4157a5729bee874e08b5', 'request_id': 'req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.500292 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cd7c67d965a4157a5729bee874e08b5', 'request_id': 'req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.507607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cd7c67d965a4157a5729bee874e08b5', 'request_id': 'req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.518561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] The token cache is being invalidate because project 0cd7c67d965a4157a5729bee874e08b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:28:30.518831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.519472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f60bf63c-b951-46a8-b7a6-e30ec2f97a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:28:30.520923 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1410/2792] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:28:30 2022] DELETE /identity/v3/projects/0cd7c67d965a4157a5729bee874e08b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:28:40.093705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:40.515599 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:46.187925 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:46.189478 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:46.247339 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64effd63-aeec-43ed-8649-b8d368640aee admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:46.295529 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:46.296165 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:46.296453 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:46.296726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:46.298449 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:46.367743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:46.369664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:46.380424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1383/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:50.322196 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186745f-6be2-4ba6-9e96-ad2ae98c6660 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:50.322739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186745f-6be2-4ba6-9e96-ad2ae98c6660 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:50.323065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186745f-6be2-4ba6-9e96-ad2ae98c6660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:50.343285 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d186745f-6be2-4ba6-9e96-ad2ae98c6660 None None] MFA Rules not processed for user `5ca8c89531e2432d8b9d98c45e6bdd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:28:50.344474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d186745f-6be2-4ba6-9e96-ad2ae98c6660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:50.397786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1411/2794] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:28:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:28:50.702267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:50.703692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:50.760040 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be823-7afa-4cb9-8726-b5fd2c0930d3 service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:50.764047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:50.764575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:50.764857 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:50.765133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:50.766841 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:50.776956 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:50.778367 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:50.782388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=100 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:28:50.786549 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1384/2795] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:52.121464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186745f-6be2-4ba6-9e96-ad2ae98c6660 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:52.122966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d186745f-6be2-4ba6-9e96-ad2ae98c6660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:52.127581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:52.136270 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b17a40-64dd-4ad4-8f0f-1b794fba8e82 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:52.139880 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:52.140496 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:52.140760 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:52.141030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:52.142743 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:52.157076 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:52.158497 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:52.170910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1385/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:28:52.197527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186745f-6be2-4ba6-9e96-ad2ae98c6660 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:52.205720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:52.206413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:52.206691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:52.206961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:52.208715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:52.221586 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:52.223219 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:52.233556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1412/2797] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:28:54.940778 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:28:54.942230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:54.953177 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346eb8-e1e4-4df1-be81-8ce490e855d5 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:28:54.956749 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaac790-580c-42b3-b561-4c0eca8fde14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:28:54.957346 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac790-580c-42b3-b561-4c0eca8fde14 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:28:54.957622 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac790-580c-42b3-b561-4c0eca8fde14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:28:54.957891 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaac790-580c-42b3-b561-4c0eca8fde14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:28:54.959872 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-cdaac790-580c-42b3-b561-4c0eca8fde14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:28:54.969881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaac790-580c-42b3-b561-4c0eca8fde14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:28:54.971324 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaac790-580c-42b3-b561-4c0eca8fde14 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:28:54.980498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1386/2798] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:28:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:29:02.228756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=57 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:29:04.976575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=12 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:24.203304 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:24.204745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:24.224009 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52467768-1aa4-44e7-b9f4-f3b254852895 service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:24.230043 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:24.230666 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:24.230949 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:24.231251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:24.233098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:24.248077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:24.249851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:24.266493 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1413/2799] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:33.784433 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665efe-cc99-4bcd-9367-4cd243f1be45 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:33.784939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665efe-cc99-4bcd-9367-4cd243f1be45 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:33.785038 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b665efe-cc99-4bcd-9367-4cd243f1be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:33.806978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2b665efe-cc99-4bcd-9367-4cd243f1be45 None None] MFA Rules not processed for user `5ca8c89531e2432d8b9d98c45e6bdd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:30:33.808929 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2b665efe-cc99-4bcd-9367-4cd243f1be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:33.815992 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1387/2800] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:30:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:30:34.258786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:43.071136 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:43.086925 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0664d-d634-4229-80de-c2a41f1f8d84 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:43.095711 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:43.096435 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:43.096899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:43.097179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:43.099036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:43.113356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:43.115138 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:43.127901 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1414/2801] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:30:43.799546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:46.080932 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b665efe-cc99-4bcd-9367-4cd243f1be45 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:30:46.095405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b665efe-cc99-4bcd-9367-4cd243f1be45 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:30:46.100963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09719d5-9197-4191-9c99-7f78f813ee46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:30:46.101637 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09719d5-9197-4191-9c99-7f78f813ee46 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:30:46.101983 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09719d5-9197-4191-9c99-7f78f813ee46 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:30:46.102347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09719d5-9197-4191-9c99-7f78f813ee46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:30:46.104184 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-e09719d5-9197-4191-9c99-7f78f813ee46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:30:46.116840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09719d5-9197-4191-9c99-7f78f813ee46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:30:46.118488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09719d5-9197-4191-9c99-7f78f813ee46 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:30:46.130107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1388/2802] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:30:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:30:53.123328 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:30:56.126201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=6 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:31:43.036125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:31:43.037505 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:43.051963 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66786b-290e-46ae-b369-e1657826db92 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:31:43.056789 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:31:43.057375 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:31:43.057654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:31:43.057928 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:31:43.059577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:31:43.070790 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:31:43.072377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:31:43.082223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1415/2803] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:31:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:31:53.077951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:32:02.972005 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206ba32-d0a9-4a94-aaa5-0571b83b52bf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:32:02.972537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206ba32-d0a9-4a94-aaa5-0571b83b52bf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:32:02.972537 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206ba32-d0a9-4a94-aaa5-0571b83b52bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:32:02.991779 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-4206ba32-d0a9-4a94-aaa5-0571b83b52bf None None] MFA Rules not processed for user `5ca8c89531e2432d8b9d98c45e6bdd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:32:02.992984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-4206ba32-d0a9-4a94-aaa5-0571b83b52bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:02.999989 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1389/2804] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:32:12.986203 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:32:15.301151 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:32:15.302669 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:15.317489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28798d1-bf2d-421b-a6dd-23d8f8d31f73 service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:32:15.324896 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:32:15.325577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:32:15.325882 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:32:15.326207 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:32:15.327997 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:32:15.338883 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:32:15.340538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:32:15.350585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1416/2805] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:32:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:32:25.346099 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:48.580696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206ba32-d0a9-4a94-aaa5-0571b83b52bf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:48.590787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206ba32-d0a9-4a94-aaa5-0571b83b52bf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:48.594520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:48.595143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:48.595424 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:48.595692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:48.597979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:48.659311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:48.661390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:48.671246 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1390/2806] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:51.728263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:51.741178 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e591843-8bcf-4c3e-9966-216b33a79751 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:51.748201 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:51.749024 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:51.749394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:51.749864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:51.751919 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:51.764543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:51.766120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:51.784712 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1417/2807] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:51.789293 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:51.791253 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:51.803595 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c8650-fd68-40de-a4cb-975b7ef15e63 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:51.809678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:51.810447 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:51.810625 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:51.810842 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] PATH_INFO: `/v3/users/5ca8c89531e2432d8b9d98c45e6bdd4a` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:51.812404 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca8c89531e2432d8b9d98c45e6bdd4a)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:51.814311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:51.864037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca8c89531e2432d8b9d98c45e6bdd4a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:51.871309 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca8c89531e2432d8b9d98c45e6bdd4a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:51.871926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca8c89531e2432d8b9d98c45e6bdd4a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:51.872538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca8c89531e2432d8b9d98c45e6bdd4a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:51.880063 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-ccfe6cde-c9d7-498d-a915-c973dd777881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca8c89531e2432d8b9d98c45e6bdd4a'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:51.898422 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1391/2808] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:33:51 2022] DELETE /identity/v3/users/5ca8c89531e2432d8b9d98c45e6bdd4a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:52.069791 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.081017 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ce425-91a7-4926-92e4-b8261ef96c16 service placement] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.139358 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.139983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.140263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.140533 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] PATH_INFO: `/v3/projects/f1eab87474af4146b3d52fbb4f5bce2d` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.141734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1eab87474af4146b3d52fbb4f5bce2d)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.143694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.197446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1eab87474af4146b3d52fbb4f5bce2d', 'request_id': 'req-33fbecca-0f81-4b53-96e7-5deb01b677b9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:52.203833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1eab87474af4146b3d52fbb4f5bce2d', 'request_id': 'req-33fbecca-0f81-4b53-96e7-5deb01b677b9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:52.212721 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1eab87474af4146b3d52fbb4f5bce2d', 'request_id': 'req-33fbecca-0f81-4b53-96e7-5deb01b677b9'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:52.224012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] The token cache is being invalidate because project f1eab87474af4146b3d52fbb4f5bce2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81368) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:33:52.224299 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:52.225263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-33fbecca-0f81-4b53-96e7-5deb01b677b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:52.226966 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1418/2809] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:33:52 2022] DELETE /identity/v3/projects/f1eab87474af4146b3d52fbb4f5bce2d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:52.231877 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664c318-7002-4ae3-932d-a9d79616af6d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.232235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664c318-7002-4ae3-932d-a9d79616af6d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.232705 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664c318-7002-4ae3-932d-a9d79616af6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.253628 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a664c318-7002-4ae3-932d-a9d79616af6d None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:52.255034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a664c318-7002-4ae3-932d-a9d79616af6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:52.317301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1392/2810] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:52.325211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056f73-0f2d-4065-afc1-56e9a4d2001f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.325497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056f73-0f2d-4065-afc1-56e9a4d2001f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.325771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c056f73-0f2d-4065-afc1-56e9a4d2001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.346464 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-7c056f73-0f2d-4065-afc1-56e9a4d2001f None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:52.348396 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-7c056f73-0f2d-4065-afc1-56e9a4d2001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:52.356280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1419/2811] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:52.360443 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664c318-7002-4ae3-932d-a9d79616af6d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.370485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664c318-7002-4ae3-932d-a9d79616af6d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.375127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.375718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.375994 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.376263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.376900 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81367) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:33:52.377199 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.378906 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.380357 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:52.393301 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1393/2812] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:33:52.398137 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c056f73-0f2d-4065-afc1-56e9a4d2001f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.407543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c056f73-0f2d-4065-afc1-56e9a4d2001f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.412832 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c4b1-d8ce-4271-a2de-62bc6a9a14b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.413427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c4b1-d8ce-4271-a2de-62bc6a9a14b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.413710 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c4b1-d8ce-4271-a2de-62bc6a9a14b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.414012 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c4b1-d8ce-4271-a2de-62bc6a9a14b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.414656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173c4b1-d8ce-4271-a2de-62bc6a9a14b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.416581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173c4b1-d8ce-4271-a2de-62bc6a9a14b8 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.443847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1420/2813] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:33:52 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:33:52.447926 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.458490 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a75d33-a0c0-4227-8247-887abc0ccac4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.513656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3378155-a8e2-4b32-8332-f6e6fb7ab9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.514258 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378155-a8e2-4b32-8332-f6e6fb7ab9dd admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.514536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378155-a8e2-4b32-8332-f6e6fb7ab9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.514811 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3378155-a8e2-4b32-8332-f6e6fb7ab9dd admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.515473 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3378155-a8e2-4b32-8332-f6e6fb7ab9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.517359 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3378155-a8e2-4b32-8332-f6e6fb7ab9dd admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.539169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1394/2814] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:33:52 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:33:52.543311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c4b1-d8ce-4271-a2de-62bc6a9a14b8 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.554524 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c4b1-d8ce-4271-a2de-62bc6a9a14b8 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.559206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f325c-32f6-475c-b5b9-a2662c6c71dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.559796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f325c-32f6-475c-b5b9-a2662c6c71dc admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.560072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f325c-32f6-475c-b5b9-a2662c6c71dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.560342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f325c-32f6-475c-b5b9-a2662c6c71dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.561021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f325c-32f6-475c-b5b9-a2662c6c71dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.562635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f325c-32f6-475c-b5b9-a2662c6c71dc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.573333 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1421/2815] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:33:52.578525 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3378155-a8e2-4b32-8332-f6e6fb7ab9dd admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.588581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3378155-a8e2-4b32-8332-f6e6fb7ab9dd admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.593351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94511334-7cbe-485b-bbf3-4a5d59896a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.593982 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94511334-7cbe-485b-bbf3-4a5d59896a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.594559 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94511334-7cbe-485b-bbf3-4a5d59896a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.594839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94511334-7cbe-485b-bbf3-4a5d59896a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.595538 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94511334-7cbe-485b-bbf3-4a5d59896a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.597729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94511334-7cbe-485b-bbf3-4a5d59896a78 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.608430 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1395/2816] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 19:33:52.612473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f325c-32f6-475c-b5b9-a2662c6c71dc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.622978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f325c-32f6-475c-b5b9-a2662c6c71dc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.627557 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9904-6635-4b2c-be8f-023204a6314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.628197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9904-6635-4b2c-be8f-023204a6314a admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.628593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9904-6635-4b2c-be8f-023204a6314a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.628876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba9904-6635-4b2c-be8f-023204a6314a admin admin] PATH_INFO: `/v3/projects/c96b1d7253204d07a08a109fd150e3a7/users/958655967d9d4bf19eade3aea47be726/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.643427 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba9904-6635-4b2c-be8f-023204a6314a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96b1d7253204d07a08a109fd150e3a7, user_id=958655967d9d4bf19eade3aea47be726, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.646237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba9904-6635-4b2c-be8f-023204a6314a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.658771 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1422/2817] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:33:52 2022] PUT /identity/v3/projects/c96b1d7253204d07a08a109fd150e3a7/users/958655967d9d4bf19eade3aea47be726/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:52.670730 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3248-dca7-4c93-a112-f265d70ea4e5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.671058 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3248-dca7-4c93-a112-f265d70ea4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.671338 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d3248-dca7-4c93-a112-f265d70ea4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.699618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-7f4d3248-dca7-4c93-a112-f265d70ea4e5 None None] MFA Rules not processed for user `958655967d9d4bf19eade3aea47be726`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:52.700839 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-7f4d3248-dca7-4c93-a112-f265d70ea4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:52.764541 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1396/2818] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:52.769245 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9904-6635-4b2c-be8f-023204a6314a admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.782632 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:52.832904 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba9904-6635-4b2c-be8f-023204a6314a admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.837534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e1e1-7adf-4a0e-b8e1-d7f7ab7962dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.838134 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e1e1-7adf-4a0e-b8e1-d7f7ab7962dc admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.838414 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e1e1-7adf-4a0e-b8e1-d7f7ab7962dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.838689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e1e1-7adf-4a0e-b8e1-d7f7ab7962dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.839341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26e1e1-7adf-4a0e-b8e1-d7f7ab7962dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.841229 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26e1e1-7adf-4a0e-b8e1-d7f7ab7962dc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.868084 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1423/2819] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:33:52 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:33:52.872375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d3248-dca7-4c93-a112-f265d70ea4e5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.883754 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d3248-dca7-4c93-a112-f265d70ea4e5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.939344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d429-a1b9-4f21-9ccb-8211965100d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.939958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d429-a1b9-4f21-9ccb-8211965100d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.940244 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d429-a1b9-4f21-9ccb-8211965100d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.940523 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075d429-a1b9-4f21-9ccb-8211965100d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.941744 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075d429-a1b9-4f21-9ccb-8211965100d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.943696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075d429-a1b9-4f21-9ccb-8211965100d9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.952441 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:52.965655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1397/2820] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:33:52 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:33:52.969858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e1e1-7adf-4a0e-b8e1-d7f7ab7962dc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:52.980218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e1e1-7adf-4a0e-b8e1-d7f7ab7962dc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:52.984799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839a536-eb01-469a-a84a-9b6e1a68dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:52.985387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839a536-eb01-469a-a84a-9b6e1a68dabb admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:52.985667 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839a536-eb01-469a-a84a-9b6e1a68dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:52.985941 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839a536-eb01-469a-a84a-9b6e1a68dabb admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:52.986577 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839a536-eb01-469a-a84a-9b6e1a68dabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:52.988880 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839a536-eb01-469a-a84a-9b6e1a68dabb admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:52.999713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1424/2821] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:33:53.004482 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d429-a1b9-4f21-9ccb-8211965100d9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:53.014676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075d429-a1b9-4f21-9ccb-8211965100d9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:53.019363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6447d1-acca-4a44-867b-046958b9035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:53.020007 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6447d1-acca-4a44-867b-046958b9035a admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:53.020294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6447d1-acca-4a44-867b-046958b9035a admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:53.020573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6447d1-acca-4a44-867b-046958b9035a admin admin] PATH_INFO: `/v3/projects/3fcceb42f2c9401987d5472a06b7fdf3/users/dd52976bbe964a309976d1e74d6f346a/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:53.035387 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6447d1-acca-4a44-867b-046958b9035a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcceb42f2c9401987d5472a06b7fdf3, user_id=dd52976bbe964a309976d1e74d6f346a, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:53.038021 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6447d1-acca-4a44-867b-046958b9035a admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:53.051521 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1398/2822] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:33:53 2022] PUT /identity/v3/projects/3fcceb42f2c9401987d5472a06b7fdf3/users/dd52976bbe964a309976d1e74d6f346a/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:53.055392 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839a536-eb01-469a-a84a-9b6e1a68dabb admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:53.065558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839a536-eb01-469a-a84a-9b6e1a68dabb admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:53.122140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94226339-6a45-4893-a7ce-83e386cd472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:53.122670 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226339-6a45-4893-a7ce-83e386cd472b admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:53.122951 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226339-6a45-4893-a7ce-83e386cd472b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:53.123262 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94226339-6a45-4893-a7ce-83e386cd472b admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:53.123899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94226339-6a45-4893-a7ce-83e386cd472b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:53.125484 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94226339-6a45-4893-a7ce-83e386cd472b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:53.136158 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1425/2823] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:33:53.140347 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6447d1-acca-4a44-867b-046958b9035a admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:53.150590 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6447d1-acca-4a44-867b-046958b9035a admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:53.155243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:53.155893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:53.156174 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:53.156455 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] PATH_INFO: `/v3/projects/3fcceb42f2c9401987d5472a06b7fdf3/users/dd52976bbe964a309976d1e74d6f346a/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:53.158373 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fcceb42f2c9401987d5472a06b7fdf3, user_id=dd52976bbe964a309976d1e74d6f346a, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:53.161304 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:53.171260 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1399/2824] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:33:53 2022] PUT /identity/v3/projects/3fcceb42f2c9401987d5472a06b7fdf3/users/dd52976bbe964a309976d1e74d6f346a/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:53.182281 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4310bf-14d8-4288-925c-7d838fd65545 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:53.182571 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4310bf-14d8-4288-925c-7d838fd65545 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:53.182853 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4310bf-14d8-4288-925c-7d838fd65545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:53.221487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-fe4310bf-14d8-4288-925c-7d838fd65545 None None] MFA Rules not processed for user `dd52976bbe964a309976d1e74d6f346a`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:53.221487 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-fe4310bf-14d8-4288-925c-7d838fd65545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:53.285930 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1426/2825] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:53.297520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:53.299351 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:53.358034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26246f64-7809-4b5b-a77e-d7c572a98bd5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:53.361604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968e001-07a5-4303-90e1-9a87c701e1d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:53.362227 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e001-07a5-4303-90e1-9a87c701e1d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:53.362511 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e001-07a5-4303-90e1-9a87c701e1d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:53.363548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e001-07a5-4303-90e1-9a87c701e1d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:53.372588 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968e001-07a5-4303-90e1-9a87c701e1d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:53.373979 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968e001-07a5-4303-90e1-9a87c701e1d2 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:53.383871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1400/2826] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:53.764065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4310bf-14d8-4288-925c-7d838fd65545 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:53.777210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:53.827996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4310bf-14d8-4288-925c-7d838fd65545 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:53.833122 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:53.833747 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:53.834022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:53.834293 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] PATH_INFO: `/v3/users/958655967d9d4bf19eade3aea47be726` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:53.835436 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958655967d9d4bf19eade3aea47be726)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:53.837346 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:53.882163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958655967d9d4bf19eade3aea47be726'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:53.888931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958655967d9d4bf19eade3aea47be726'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:53.889735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958655967d9d4bf19eade3aea47be726'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:53.890390 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958655967d9d4bf19eade3aea47be726'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:53.903243 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958655967d9d4bf19eade3aea47be726'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:53.916251 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1427/2827] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:33:53 2022] DELETE /identity/v3/users/958655967d9d4bf19eade3aea47be726 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:53.920766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466ec08-7be4-4f5e-9540-dcde81673ecf None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:53.921236 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466ec08-7be4-4f5e-9540-dcde81673ecf None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:53.921335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466ec08-7be4-4f5e-9540-dcde81673ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:53.940386 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9466ec08-7be4-4f5e-9540-dcde81673ecf None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:53.942294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9466ec08-7be4-4f5e-9540-dcde81673ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:54.000027 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1401/2828] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:54.010322 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:54.011774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:54.069893 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e111ce-c5e1-477b-b5af-31b48a1f9908 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:54.073564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f48cde-1217-46cc-814f-135bd33588c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:54.074166 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48cde-1217-46cc-814f-135bd33588c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:54.074446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48cde-1217-46cc-814f-135bd33588c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:54.074718 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f48cde-1217-46cc-814f-135bd33588c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:54.084342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f48cde-1217-46cc-814f-135bd33588c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:54.085757 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f48cde-1217-46cc-814f-135bd33588c6 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:54.095371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1428/2829] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:54.356242 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466ec08-7be4-4f5e-9540-dcde81673ecf None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:54.357673 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9466ec08-7be4-4f5e-9540-dcde81673ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:54.370486 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466ec08-7be4-4f5e-9540-dcde81673ecf None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:54.375297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:54.375921 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:54.376202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:54.376477 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] PATH_INFO: `/v3/projects/c96b1d7253204d07a08a109fd150e3a7` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:54.377626 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96b1d7253204d07a08a109fd150e3a7)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:54.379783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:54.427308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96b1d7253204d07a08a109fd150e3a7', 'request_id': 'req-43c8006d-5081-4958-807f-78539a6ef6f9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.429837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:54.434959 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96b1d7253204d07a08a109fd150e3a7', 'request_id': 'req-43c8006d-5081-4958-807f-78539a6ef6f9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.444348 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96b1d7253204d07a08a109fd150e3a7', 'request_id': 'req-43c8006d-5081-4958-807f-78539a6ef6f9'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.454672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] The token cache is being invalidate because project c96b1d7253204d07a08a109fd150e3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:33:54.454964 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.455611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.457714 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1402/2830] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:33:54 2022] DELETE /identity/v3/projects/c96b1d7253204d07a08a109fd150e3a7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:33:54.461734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f48cde-1217-46cc-814f-135bd33588c6 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:54.471564 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f48cde-1217-46cc-814f-135bd33588c6 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:54.501120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:54.529905 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:54.530523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:54.530798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:54.531102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] PATH_INFO: `/v3/users/dd52976bbe964a309976d1e74d6f346a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:54.532190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd52976bbe964a309976d1e74d6f346a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:54.534083 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:54.578523 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd52976bbe964a309976d1e74d6f346a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.586238 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd52976bbe964a309976d1e74d6f346a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.586843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd52976bbe964a309976d1e74d6f346a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.587481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd52976bbe964a309976d1e74d6f346a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.600239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-0c798f64-1d12-4057-bc70-00785d48b133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd52976bbe964a309976d1e74d6f346a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:54.612224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1429/2831] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:33:54 2022] DELETE /identity/v3/users/dd52976bbe964a309976d1e74d6f346a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:33:54.885352 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:54.886873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:54.900044 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8006d-5081-4958-807f-78539a6ef6f9 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:54.957751 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:54.958408 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:54.958662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:54.958935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] PATH_INFO: `/v3/projects/3fcceb42f2c9401987d5472a06b7fdf3` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:54.960218 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fcceb42f2c9401987d5472a06b7fdf3)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:54.962171 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.009176 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fcceb42f2c9401987d5472a06b7fdf3', 'request_id': 'req-982e1b08-c52c-4f95-8b32-133a17f69716'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:55.015423 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fcceb42f2c9401987d5472a06b7fdf3', 'request_id': 'req-982e1b08-c52c-4f95-8b32-133a17f69716'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:55.023235 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fcceb42f2c9401987d5472a06b7fdf3', 'request_id': 'req-982e1b08-c52c-4f95-8b32-133a17f69716'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:55.033384 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] The token cache is being invalidate because project 3fcceb42f2c9401987d5472a06b7fdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:33:55.033680 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:55.034328 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-982e1b08-c52c-4f95-8b32-133a17f69716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:33:55.036545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1403/2832] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:33:54 2022] DELETE /identity/v3/projects/3fcceb42f2c9401987d5472a06b7fdf3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:55.041311 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0bd0c-e13e-4f99-a630-4d1c84fd7940 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.041777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0bd0c-e13e-4f99-a630-4d1c84fd7940 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.041911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0bd0c-e13e-4f99-a630-4d1c84fd7940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.061556 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-04a0bd0c-e13e-4f99-a630-4d1c84fd7940 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:55.062739 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-04a0bd0c-e13e-4f99-a630-4d1c84fd7940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:55.123625 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1430/2833] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:55.131247 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207162-3dec-44b9-a1e7-25551abd2233 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.131546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207162-3dec-44b9-a1e7-25551abd2233 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.131856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e207162-3dec-44b9-a1e7-25551abd2233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.151923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0e207162-3dec-44b9-a1e7-25551abd2233 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:55.153143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0e207162-3dec-44b9-a1e7-25551abd2233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:55.161884 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1404/2834] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:55.166064 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0bd0c-e13e-4f99-a630-4d1c84fd7940 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.175977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a0bd0c-e13e-4f99-a630-4d1c84fd7940 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.180610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.181223 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.181486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.181759 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.182430 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:33:55.182731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.184368 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.195808 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1431/2835] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:33:55.200064 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e207162-3dec-44b9-a1e7-25551abd2233 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.210371 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e207162-3dec-44b9-a1e7-25551abd2233 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.214952 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a06bfa-a046-4666-b5c9-22fc648474b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.215573 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06bfa-a046-4666-b5c9-22fc648474b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.215854 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06bfa-a046-4666-b5c9-22fc648474b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.216154 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a06bfa-a046-4666-b5c9-22fc648474b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.216794 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a06bfa-a046-4666-b5c9-22fc648474b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.218662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a06bfa-a046-4666-b5c9-22fc648474b3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.246958 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1405/2836] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:33:55 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:33:55.250935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.261197 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3adb4-12cd-4db6-a4cd-66da4996d37e admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.294876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:55.323805 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97631c36-3400-44f5-8e08-e7ec4aca4dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.324408 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97631c36-3400-44f5-8e08-e7ec4aca4dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.324687 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97631c36-3400-44f5-8e08-e7ec4aca4dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.324958 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97631c36-3400-44f5-8e08-e7ec4aca4dfc admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.325581 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97631c36-3400-44f5-8e08-e7ec4aca4dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.327504 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97631c36-3400-44f5-8e08-e7ec4aca4dfc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.348798 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1432/2837] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:33:55 2022] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:33:55.352957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a06bfa-a046-4666-b5c9-22fc648474b3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.365030 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a06bfa-a046-4666-b5c9-22fc648474b3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.370229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d0ae-851f-47c4-a97c-ec8f40001b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.370825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d0ae-851f-47c4-a97c-ec8f40001b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.371142 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d0ae-851f-47c4-a97c-ec8f40001b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.371416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d0ae-851f-47c4-a97c-ec8f40001b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.372051 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05d0ae-851f-47c4-a97c-ec8f40001b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.373939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05d0ae-851f-47c4-a97c-ec8f40001b7d admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.384667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1406/2838] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:33:55.388607 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97631c36-3400-44f5-8e08-e7ec4aca4dfc admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.398846 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97631c36-3400-44f5-8e08-e7ec4aca4dfc admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.403440 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a5607-c9de-4bf6-8349-944b2b75e6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.404036 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5607-c9de-4bf6-8349-944b2b75e6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.404316 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5607-c9de-4bf6-8349-944b2b75e6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.404590 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5607-c9de-4bf6-8349-944b2b75e6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.405225 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a5607-c9de-4bf6-8349-944b2b75e6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.406800 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a5607-c9de-4bf6-8349-944b2b75e6e7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.417486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1433/2839] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:33:55.421674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d0ae-851f-47c4-a97c-ec8f40001b7d admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.432375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05d0ae-851f-47c4-a97c-ec8f40001b7d admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.437072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69021a0-5912-4c85-89a1-a1e3752fc4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.437726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69021a0-5912-4c85-89a1-a1e3752fc4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.438010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69021a0-5912-4c85-89a1-a1e3752fc4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.438310 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69021a0-5912-4c85-89a1-a1e3752fc4a5 admin admin] PATH_INFO: `/v3/projects/e715496aafe847b6bce5847c5878514c/users/387045a0f45d4e1ca1fd0b5f09dc34d0/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.453560 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69021a0-5912-4c85-89a1-a1e3752fc4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e715496aafe847b6bce5847c5878514c, user_id=387045a0f45d4e1ca1fd0b5f09dc34d0, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.456224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69021a0-5912-4c85-89a1-a1e3752fc4a5 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.469488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1407/2840] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:33:55 2022] PUT /identity/v3/projects/e715496aafe847b6bce5847c5878514c/users/387045a0f45d4e1ca1fd0b5f09dc34d0/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:55.480701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5691d6-3bbc-428a-90a4-872b615fe4dd None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.480984 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5691d6-3bbc-428a-90a4-872b615fe4dd None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.481257 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5691d6-3bbc-428a-90a4-872b615fe4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.509713 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-ac5691d6-3bbc-428a-90a4-872b615fe4dd None None] MFA Rules not processed for user `387045a0f45d4e1ca1fd0b5f09dc34d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:55.510935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ac5691d6-3bbc-428a-90a4-872b615fe4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:55.575034 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1434/2841] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:55.579509 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69021a0-5912-4c85-89a1-a1e3752fc4a5 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.588415 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:55.644215 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69021a0-5912-4c85-89a1-a1e3752fc4a5 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.648894 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09296a65-fbcb-400e-9022-d776c75fba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.649500 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09296a65-fbcb-400e-9022-d776c75fba13 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.649786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09296a65-fbcb-400e-9022-d776c75fba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.650066 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09296a65-fbcb-400e-9022-d776c75fba13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.650708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09296a65-fbcb-400e-9022-d776c75fba13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.652655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09296a65-fbcb-400e-9022-d776c75fba13 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.682107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1408/2842] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:33:55 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:33:55.683851 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5691d6-3bbc-428a-90a4-872b615fe4dd None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.694807 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5691d6-3bbc-428a-90a4-872b615fe4dd None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.752497 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e579-ee5c-4a31-a0a0-225b59358256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.753022 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e579-ee5c-4a31-a0a0-225b59358256 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.753342 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e579-ee5c-4a31-a0a0-225b59358256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.753627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729e579-ee5c-4a31-a0a0-225b59358256 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.754255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729e579-ee5c-4a31-a0a0-225b59358256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.756181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729e579-ee5c-4a31-a0a0-225b59358256 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.777655 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1435/2843] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:33:55 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:33:55.781671 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09296a65-fbcb-400e-9022-d776c75fba13 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.792466 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09296a65-fbcb-400e-9022-d776c75fba13 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.797724 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc2a72-f1f3-4ad3-8a3f-a79826d0ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.798318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc2a72-f1f3-4ad3-8a3f-a79826d0ca24 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.798597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc2a72-f1f3-4ad3-8a3f-a79826d0ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.798871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc2a72-f1f3-4ad3-8a3f-a79826d0ca24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.799571 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc2a72-f1f3-4ad3-8a3f-a79826d0ca24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.802127 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc2a72-f1f3-4ad3-8a3f-a79826d0ca24 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.812667 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1409/2844] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:33:55.817124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e579-ee5c-4a31-a0a0-225b59358256 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.827070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729e579-ee5c-4a31-a0a0-225b59358256 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.831794 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be048a66-35b4-44a5-8e1d-7799ea07195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.832434 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048a66-35b4-44a5-8e1d-7799ea07195b admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.832715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048a66-35b4-44a5-8e1d-7799ea07195b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.832992 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be048a66-35b4-44a5-8e1d-7799ea07195b admin admin] PATH_INFO: `/v3/projects/e02e9d138ee74591a0d51e23011c9719/users/7ed3562702d84393aa733cc0c636598f/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.848065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be048a66-35b4-44a5-8e1d-7799ea07195b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02e9d138ee74591a0d51e23011c9719, user_id=7ed3562702d84393aa733cc0c636598f, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.850631 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be048a66-35b4-44a5-8e1d-7799ea07195b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.863619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1436/2845] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:33:55 2022] PUT /identity/v3/projects/e02e9d138ee74591a0d51e23011c9719/users/7ed3562702d84393aa733cc0c636598f/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:33:55.867539 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc2a72-f1f3-4ad3-8a3f-a79826d0ca24 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.877476 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc2a72-f1f3-4ad3-8a3f-a79826d0ca24 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.934378 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8b0e9-07e8-433a-8384-3d24bda52255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.934984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8b0e9-07e8-433a-8384-3d24bda52255 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.935289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8b0e9-07e8-433a-8384-3d24bda52255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.935564 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8b0e9-07e8-433a-8384-3d24bda52255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.936200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8b0e9-07e8-433a-8384-3d24bda52255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.937761 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8b0e9-07e8-433a-8384-3d24bda52255 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.947405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1410/2846] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:33:55.951473 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be048a66-35b4-44a5-8e1d-7799ea07195b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:55.962653 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be048a66-35b4-44a5-8e1d-7799ea07195b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:55.967272 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:55.967914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.968192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.968463 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] PATH_INFO: `/v3/projects/e02e9d138ee74591a0d51e23011c9719/users/7ed3562702d84393aa733cc0c636598f/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:55.970633 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02e9d138ee74591a0d51e23011c9719, user_id=7ed3562702d84393aa733cc0c636598f, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:55.974077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:55.979520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:55.985611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1437/2847] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:33:55 2022] PUT /identity/v3/projects/e02e9d138ee74591a0d51e23011c9719/users/7ed3562702d84393aa733cc0c636598f/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:33:55.996024 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7309f9-68ee-4830-a373-316ff65ca074 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:55.996570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7309f9-68ee-4830-a373-316ff65ca074 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:55.996570 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7309f9-68ee-4830-a373-316ff65ca074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:56.025068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-0d7309f9-68ee-4830-a373-316ff65ca074 None None] MFA Rules not processed for user `7ed3562702d84393aa733cc0c636598f`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:33:56.026202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0d7309f9-68ee-4830-a373-316ff65ca074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:56.093790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1411/2848] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:33:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:33:56.105990 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:56.107769 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:33:56.165999 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db35ff-ee4f-4005-8c75-61eebed16e7b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:56.169858 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94436-5f2f-4cea-826a-75069851793c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:56.170457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94436-5f2f-4cea-826a-75069851793c service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:56.170734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94436-5f2f-4cea-826a-75069851793c service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:56.171030 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94436-5f2f-4cea-826a-75069851793c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:56.180235 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94436-5f2f-4cea-826a-75069851793c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:56.181638 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94436-5f2f-4cea-826a-75069851793c service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:56.191466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1438/2849] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:33:56.267233 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7309f9-68ee-4830-a373-316ff65ca074 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:33:56.272712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:33:56.279325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7309f9-68ee-4830-a373-316ff65ca074 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:33:56.283034 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536a223-aee3-4848-888b-26987d55b7ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:33:56.283632 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a223-aee3-4848-888b-26987d55b7ea service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:33:56.283910 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a223-aee3-4848-888b-26987d55b7ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:33:56.284182 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a223-aee3-4848-888b-26987d55b7ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:33:56.339813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536a223-aee3-4848-888b-26987d55b7ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:33:56.341225 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536a223-aee3-4848-888b-26987d55b7ea service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:33:56.351157 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1412/2850] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:33:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:06.187006 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=27 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:06.346375 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=27 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:11.331947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94436-5f2f-4cea-826a-75069851793c service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:11.398432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94436-5f2f-4cea-826a-75069851793c service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:11.403218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:11.403843 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:11.404125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:11.404404 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] PATH_INFO: `/v3/users/387045a0f45d4e1ca1fd0b5f09dc34d0` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:11.405520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387045a0f45d4e1ca1fd0b5f09dc34d0)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:11.407454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:11.458513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387045a0f45d4e1ca1fd0b5f09dc34d0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:11.465937 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387045a0f45d4e1ca1fd0b5f09dc34d0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:11.466575 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387045a0f45d4e1ca1fd0b5f09dc34d0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:11.467210 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387045a0f45d4e1ca1fd0b5f09dc34d0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:11.479433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387045a0f45d4e1ca1fd0b5f09dc34d0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:11.493068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1439/2851] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:34:11 2022] DELETE /identity/v3/users/387045a0f45d4e1ca1fd0b5f09dc34d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:11.497548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15fcfa-d86d-4013-9390-ec77e211e4a4 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:11.498028 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15fcfa-d86d-4013-9390-ec77e211e4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:11.498140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15fcfa-d86d-4013-9390-ec77e211e4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:11.517984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5b15fcfa-d86d-4013-9390-ec77e211e4a4 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:11.519234 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5b15fcfa-d86d-4013-9390-ec77e211e4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:11.576888 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1413/2852] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:11.587007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:11.588412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:11.645630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40ece6-5111-413a-889b-806a01ac8181 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:11.650021 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9836e-2647-411c-861c-553fe0b2ee56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:11.650614 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9836e-2647-411c-861c-553fe0b2ee56 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:11.650891 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9836e-2647-411c-861c-553fe0b2ee56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:11.651190 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9836e-2647-411c-861c-553fe0b2ee56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:11.660409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9836e-2647-411c-861c-553fe0b2ee56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:11.661818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9836e-2647-411c-861c-553fe0b2ee56 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:11.671716 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1440/2853] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:11.934562 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15fcfa-d86d-4013-9390-ec77e211e4a4 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:11.936085 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5b15fcfa-d86d-4013-9390-ec77e211e4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:11.950300 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15fcfa-d86d-4013-9390-ec77e211e4a4 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:11.955955 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:11.957107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:11.957243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:11.957520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] PATH_INFO: `/v3/projects/e715496aafe847b6bce5847c5878514c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:11.958708 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e715496aafe847b6bce5847c5878514c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:11.961269 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:12.007380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e715496aafe847b6bce5847c5878514c', 'request_id': 'req-16335a31-12f3-4580-8857-c4dab16a74cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.013732 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e715496aafe847b6bce5847c5878514c', 'request_id': 'req-16335a31-12f3-4580-8857-c4dab16a74cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.020879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e715496aafe847b6bce5847c5878514c', 'request_id': 'req-16335a31-12f3-4580-8857-c4dab16a74cb'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.031950 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] The token cache is being invalidate because project e715496aafe847b6bce5847c5878514c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:34:12.032239 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.032856 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.034316 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1414/2854] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:34:11 2022] DELETE /identity/v3/projects/e715496aafe847b6bce5847c5878514c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:12.038658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9836e-2647-411c-861c-553fe0b2ee56 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:12.048382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9836e-2647-411c-861c-553fe0b2ee56 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:12.066912 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:12.108740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:12.109698 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.110037 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.110265 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] PATH_INFO: `/v3/users/7ed3562702d84393aa733cc0c636598f` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.111444 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed3562702d84393aa733cc0c636598f)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:12.113382 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:12.157679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed3562702d84393aa733cc0c636598f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.165602 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed3562702d84393aa733cc0c636598f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.166154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed3562702d84393aa733cc0c636598f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.166842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed3562702d84393aa733cc0c636598f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.178856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-be6da586-8dd5-4df9-8f5d-8758fe446c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed3562702d84393aa733cc0c636598f'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.191694 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1441/2855] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:34:12 2022] DELETE /identity/v3/users/7ed3562702d84393aa733cc0c636598f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:12.460130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:12.461585 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:12.475935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335a31-12f3-4580-8857-c4dab16a74cb admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:12.531981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:12.532655 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.532876 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.533147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] PATH_INFO: `/v3/projects/e02e9d138ee74591a0d51e23011c9719` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.534249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02e9d138ee74591a0d51e23011c9719)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:12.536161 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:12.566656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:12.584282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02e9d138ee74591a0d51e23011c9719', 'request_id': 'req-55b55fae-ad59-4e59-81e4-67236ec5778c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.590498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02e9d138ee74591a0d51e23011c9719', 'request_id': 'req-55b55fae-ad59-4e59-81e4-67236ec5778c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.597865 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02e9d138ee74591a0d51e23011c9719', 'request_id': 'req-55b55fae-ad59-4e59-81e4-67236ec5778c'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.608829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] The token cache is being invalidate because project e02e9d138ee74591a0d51e23011c9719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:34:12.609122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.609761 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-55b55fae-ad59-4e59-81e4-67236ec5778c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:12.611797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1415/2856] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:34:12 2022] DELETE /identity/v3/projects/e02e9d138ee74591a0d51e23011c9719 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:34:12.618681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9c7a-b9b2-4c1c-ba54-19013e45ecbb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.619203 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9c7a-b9b2-4c1c-ba54-19013e45ecbb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.619321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9c7a-b9b2-4c1c-ba54-19013e45ecbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.638610 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-2c8d9c7a-b9b2-4c1c-ba54-19013e45ecbb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:12.639767 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-2c8d9c7a-b9b2-4c1c-ba54-19013e45ecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:12.698035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1442/2857] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:12.707020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bcf0-842a-426d-a4dd-bf62c5a29beb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.707321 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bcf0-842a-426d-a4dd-bf62c5a29beb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.707597 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162bcf0-842a-426d-a4dd-bf62c5a29beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.728790 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f162bcf0-842a-426d-a4dd-bf62c5a29beb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:12.730009 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f162bcf0-842a-426d-a4dd-bf62c5a29beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:12.738052 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1416/2858] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:12.743032 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d9c7a-b9b2-4c1c-ba54-19013e45ecbb None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:12.752772 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d9c7a-b9b2-4c1c-ba54-19013e45ecbb None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:12.757263 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:12.757847 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.758125 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.758394 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.759058 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:34:12.759360 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:12.760934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:12.772751 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1443/2859] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 19:34:12.776887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162bcf0-842a-426d-a4dd-bf62c5a29beb None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:12.786062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162bcf0-842a-426d-a4dd-bf62c5a29beb None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:12.791504 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea291-2e08-4ef6-be72-02c380eaa522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:12.792096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea291-2e08-4ef6-be72-02c380eaa522 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.792395 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea291-2e08-4ef6-be72-02c380eaa522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.792657 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea291-2e08-4ef6-be72-02c380eaa522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.793285 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ea291-2e08-4ef6-be72-02c380eaa522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:12.795195 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ea291-2e08-4ef6-be72-02c380eaa522 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:12.822197 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1417/2860] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:34:12 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:34:12.826307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:12.837173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f3b5-3bb4-4fd5-9fcd-02f0c7e08dad admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:12.863481 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:12.895887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361672b7-7cab-4ca1-81c9-361451b90449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:12.896416 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361672b7-7cab-4ca1-81c9-361451b90449 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.897275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361672b7-7cab-4ca1-81c9-361451b90449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.897593 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361672b7-7cab-4ca1-81c9-361451b90449 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.898280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361672b7-7cab-4ca1-81c9-361451b90449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:12.900214 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361672b7-7cab-4ca1-81c9-361451b90449 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:12.921211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1444/2861] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:34:12 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:34:12.925220 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea291-2e08-4ef6-be72-02c380eaa522 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:12.935472 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea291-2e08-4ef6-be72-02c380eaa522 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:12.940046 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fd5d9-1237-49e0-b10d-89fa2a613981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:12.940638 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fd5d9-1237-49e0-b10d-89fa2a613981 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.940918 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fd5d9-1237-49e0-b10d-89fa2a613981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.941192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fd5d9-1237-49e0-b10d-89fa2a613981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.941827 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fd5d9-1237-49e0-b10d-89fa2a613981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:12.943442 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fd5d9-1237-49e0-b10d-89fa2a613981 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:12.953416 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1418/2862] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:12.957278 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361672b7-7cab-4ca1-81c9-361451b90449 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:12.967730 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361672b7-7cab-4ca1-81c9-361451b90449 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:12.972519 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63193612-34a6-4066-bed5-70254c8c0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:12.973100 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193612-34a6-4066-bed5-70254c8c0579 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:12.973376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193612-34a6-4066-bed5-70254c8c0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:12.973648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63193612-34a6-4066-bed5-70254c8c0579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:12.974275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63193612-34a6-4066-bed5-70254c8c0579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:12.976429 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63193612-34a6-4066-bed5-70254c8c0579 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:12.987887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1445/2863] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:12.992173 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fd5d9-1237-49e0-b10d-89fa2a613981 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.002072 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fd5d9-1237-49e0-b10d-89fa2a613981 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.006648 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac994c2e-29e0-4b14-9d4d-f800d49510ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.007318 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac994c2e-29e0-4b14-9d4d-f800d49510ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.007601 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac994c2e-29e0-4b14-9d4d-f800d49510ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.007879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac994c2e-29e0-4b14-9d4d-f800d49510ed admin admin] PATH_INFO: `/v3/projects/b65ea9d33eee45d4897ef1e7e563e7df/users/c98bb0637e2d410e8e702d709ed9c079/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.022892 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac994c2e-29e0-4b14-9d4d-f800d49510ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65ea9d33eee45d4897ef1e7e563e7df, user_id=c98bb0637e2d410e8e702d709ed9c079, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.025692 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac994c2e-29e0-4b14-9d4d-f800d49510ed admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.038651 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1419/2864] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:34:12 2022] PUT /identity/v3/projects/b65ea9d33eee45d4897ef1e7e563e7df/users/c98bb0637e2d410e8e702d709ed9c079/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:13.048796 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0db5-5b93-4478-b8dc-02c979addf93 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.049078 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0db5-5b93-4478-b8dc-02c979addf93 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.049349 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0db5-5b93-4478-b8dc-02c979addf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.076113 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e54e0db5-5b93-4478-b8dc-02c979addf93 None None] MFA Rules not processed for user `c98bb0637e2d410e8e702d709ed9c079`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:13.077307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e54e0db5-5b93-4478-b8dc-02c979addf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:13.144871 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1446/2865] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:13.149990 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac994c2e-29e0-4b14-9d4d-f800d49510ed admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.213107 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac994c2e-29e0-4b14-9d4d-f800d49510ed admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.217720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72321ab2-bfaa-4e6a-9a35-97aab63a6496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.218316 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72321ab2-bfaa-4e6a-9a35-97aab63a6496 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.218591 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72321ab2-bfaa-4e6a-9a35-97aab63a6496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.218859 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72321ab2-bfaa-4e6a-9a35-97aab63a6496 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.219771 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72321ab2-bfaa-4e6a-9a35-97aab63a6496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.221716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72321ab2-bfaa-4e6a-9a35-97aab63a6496 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.247668 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1420/2866] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:34:13 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:34:13.251630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e0db5-5b93-4478-b8dc-02c979addf93 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.262911 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e0db5-5b93-4478-b8dc-02c979addf93 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.317001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06aac-0507-423f-8413-c1734ff28134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.317709 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06aac-0507-423f-8413-c1734ff28134 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.317987 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06aac-0507-423f-8413-c1734ff28134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.318366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e06aac-0507-423f-8413-c1734ff28134 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.319760 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e06aac-0507-423f-8413-c1734ff28134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.321660 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e06aac-0507-423f-8413-c1734ff28134 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.342071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1447/2867] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:34:13 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:34:13.346204 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72321ab2-bfaa-4e6a-9a35-97aab63a6496 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.357175 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72321ab2-bfaa-4e6a-9a35-97aab63a6496 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.361846 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa8cc3-31b2-48b6-815c-1a8fecc7c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.362436 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8cc3-31b2-48b6-815c-1a8fecc7c91e admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.362715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8cc3-31b2-48b6-815c-1a8fecc7c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.363017 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa8cc3-31b2-48b6-815c-1a8fecc7c91e admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.363649 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa8cc3-31b2-48b6-815c-1a8fecc7c91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.365230 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa8cc3-31b2-48b6-815c-1a8fecc7c91e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.376319 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1421/2868] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:13.380405 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06aac-0507-423f-8413-c1734ff28134 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.391023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e06aac-0507-423f-8413-c1734ff28134 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.395585 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc13644-9e36-4605-ac21-c29d5fcbabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.396176 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc13644-9e36-4605-ac21-c29d5fcbabf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.396457 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc13644-9e36-4605-ac21-c29d5fcbabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.396841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc13644-9e36-4605-ac21-c29d5fcbabf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.397506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc13644-9e36-4605-ac21-c29d5fcbabf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.399366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc13644-9e36-4605-ac21-c29d5fcbabf7 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.410019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1448/2869] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:13.414825 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa8cc3-31b2-48b6-815c-1a8fecc7c91e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.424785 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa8cc3-31b2-48b6-815c-1a8fecc7c91e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.430419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519d773-73ff-42e3-aee4-f45979dfade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.431121 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d773-73ff-42e3-aee4-f45979dfade3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.431401 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d773-73ff-42e3-aee4-f45979dfade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.431678 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519d773-73ff-42e3-aee4-f45979dfade3 admin admin] PATH_INFO: `/v3/projects/0fc75aa61d534900ac02c43b5022446d/users/cd3b549d0d47492aa6466f26ec1bdcba/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.449041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519d773-73ff-42e3-aee4-f45979dfade3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc75aa61d534900ac02c43b5022446d, user_id=cd3b549d0d47492aa6466f26ec1bdcba, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.451768 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519d773-73ff-42e3-aee4-f45979dfade3 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.463291 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:13.468397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1422/2870] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:34:13 2022] PUT /identity/v3/projects/0fc75aa61d534900ac02c43b5022446d/users/cd3b549d0d47492aa6466f26ec1bdcba/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:13.482461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea81b-401a-4757-9094-c714252b72f8 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.482899 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea81b-401a-4757-9094-c714252b72f8 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.483302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ea81b-401a-4757-9094-c714252b72f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.515077 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-989ea81b-401a-4757-9094-c714252b72f8 None None] MFA Rules not processed for user `cd3b549d0d47492aa6466f26ec1bdcba`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:13.516303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-989ea81b-401a-4757-9094-c714252b72f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:13.520451 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:13.582965 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1449/2871] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:34:13.588073 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519d773-73ff-42e3-aee4-f45979dfade3 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.650871 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519d773-73ff-42e3-aee4-f45979dfade3 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.655586 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8859f1-06a2-46f0-8ab8-5faa871912da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.656188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8859f1-06a2-46f0-8ab8-5faa871912da admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.656467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8859f1-06a2-46f0-8ab8-5faa871912da admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.656740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8859f1-06a2-46f0-8ab8-5faa871912da admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.657410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8859f1-06a2-46f0-8ab8-5faa871912da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.659255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8859f1-06a2-46f0-8ab8-5faa871912da admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.685858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1423/2872] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:34:13 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:34:13.689841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ea81b-401a-4757-9094-c714252b72f8 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.701015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ea81b-401a-4757-9094-c714252b72f8 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.758091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678bad4-24f6-47c3-9141-bba7876a4c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.758695 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678bad4-24f6-47c3-9141-bba7876a4c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.758978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678bad4-24f6-47c3-9141-bba7876a4c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.759290 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678bad4-24f6-47c3-9141-bba7876a4c0c admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.759932 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678bad4-24f6-47c3-9141-bba7876a4c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.761857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678bad4-24f6-47c3-9141-bba7876a4c0c admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.783580 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1450/2873] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:34:13 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:34:13.788217 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8859f1-06a2-46f0-8ab8-5faa871912da admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.798604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8859f1-06a2-46f0-8ab8-5faa871912da admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.803369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6f63-bccd-4e6d-a811-8f80749cab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.804119 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6f63-bccd-4e6d-a811-8f80749cab2b admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.804400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6f63-bccd-4e6d-a811-8f80749cab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.804676 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a6f63-bccd-4e6d-a811-8f80749cab2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.805306 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a6f63-bccd-4e6d-a811-8f80749cab2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.806881 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a6f63-bccd-4e6d-a811-8f80749cab2b admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.817691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1424/2874] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:13.821862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678bad4-24f6-47c3-9141-bba7876a4c0c admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.831777 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678bad4-24f6-47c3-9141-bba7876a4c0c admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.837081 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147c89-b35b-4a0f-8c52-aae303df9fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.837720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147c89-b35b-4a0f-8c52-aae303df9fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.838001 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147c89-b35b-4a0f-8c52-aae303df9fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.838275 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147c89-b35b-4a0f-8c52-aae303df9fa6 admin admin] PATH_INFO: `/v3/projects/1fb2958f555d4f629ca7c9a332931c2e/users/6f3921a4ec7f4e92b0d6cedf7f13a61a/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.853935 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147c89-b35b-4a0f-8c52-aae303df9fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb2958f555d4f629ca7c9a332931c2e, user_id=6f3921a4ec7f4e92b0d6cedf7f13a61a, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.856654 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147c89-b35b-4a0f-8c52-aae303df9fa6 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.869489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1451/2875] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:34:13 2022] PUT /identity/v3/projects/1fb2958f555d4f629ca7c9a332931c2e/users/6f3921a4ec7f4e92b0d6cedf7f13a61a/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:13.873262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6f63-bccd-4e6d-a811-8f80749cab2b admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.883813 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a6f63-bccd-4e6d-a811-8f80749cab2b admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.939661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c416872-d610-474c-bdb4-0e1af66db5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.940188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416872-d610-474c-bdb4-0e1af66db5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.940467 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416872-d610-474c-bdb4-0e1af66db5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.940740 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416872-d610-474c-bdb4-0e1af66db5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.941363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c416872-d610-474c-bdb4-0e1af66db5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.942936 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c416872-d610-474c-bdb4-0e1af66db5aa admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.952980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1425/2876] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:13.957018 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147c89-b35b-4a0f-8c52-aae303df9fa6 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:13.967639 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147c89-b35b-4a0f-8c52-aae303df9fa6 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:13.972359 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:13.972992 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:13.973274 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:13.973546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] PATH_INFO: `/v3/projects/1fb2958f555d4f629ca7c9a332931c2e/users/6f3921a4ec7f4e92b0d6cedf7f13a61a/roles/0f99070a6a88400199520fccd98977b6` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:13.975503 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb2958f555d4f629ca7c9a332931c2e, user_id=6f3921a4ec7f4e92b0d6cedf7f13a61a, role_id=0f99070a6a88400199520fccd98977b6)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:13.978087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:13.988327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1452/2877] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:34:13 2022] PUT /identity/v3/projects/1fb2958f555d4f629ca7c9a332931c2e/users/6f3921a4ec7f4e92b0d6cedf7f13a61a/roles/0f99070a6a88400199520fccd98977b6 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 19:34:14.051419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbd1c3-cd47-42a2-ba98-f1db2c06da21 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:14.051704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbd1c3-cd47-42a2-ba98-f1db2c06da21 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:14.052014 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbd1c3-cd47-42a2-ba98-f1db2c06da21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:14.080179 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-d2bbd1c3-cd47-42a2-ba98-f1db2c06da21 None None] MFA Rules not processed for user `6f3921a4ec7f4e92b0d6cedf7f13a61a`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:14.081383 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d2bbd1c3-cd47-42a2-ba98-f1db2c06da21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:14.139747 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:14.150294 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1426/2878] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:14.161161 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:14.163239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:14.220773 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e46abf-221d-49ba-8a51-66370f1d18ed admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:14.224486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be304e5-df32-455e-aaf8-4f220d06b80d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:14.225173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be304e5-df32-455e-aaf8-4f220d06b80d service cinder] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:14.225458 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be304e5-df32-455e-aaf8-4f220d06b80d service cinder] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:14.225734 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be304e5-df32-455e-aaf8-4f220d06b80d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:14.234766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be304e5-df32-455e-aaf8-4f220d06b80d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:14.236234 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be304e5-df32-455e-aaf8-4f220d06b80d service cinder] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:14.241717 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:14.247033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1453/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:14.288608 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbd1c3-cd47-42a2-ba98-f1db2c06da21 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:14.290020 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-d2bbd1c3-cd47-42a2-ba98-f1db2c06da21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:14.301866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbd1c3-cd47-42a2-ba98-f1db2c06da21 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:14.305531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11500ce7-8584-42ee-9432-75ae70a7d99c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:14.306126 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11500ce7-8584-42ee-9432-75ae70a7d99c service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:14.306405 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11500ce7-8584-42ee-9432-75ae70a7d99c service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:14.306679 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11500ce7-8584-42ee-9432-75ae70a7d99c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:14.362695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11500ce7-8584-42ee-9432-75ae70a7d99c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:14.364145 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11500ce7-8584-42ee-9432-75ae70a7d99c service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:14.372860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1427/2880] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:17.252466 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be304e5-df32-455e-aaf8-4f220d06b80d service cinder] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:17.317745 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be304e5-df32-455e-aaf8-4f220d06b80d service cinder] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:17.323350 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:17.324035 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:17.324320 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:17.324589 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] PATH_INFO: `/v3/users/c98bb0637e2d410e8e702d709ed9c079` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:17.325685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98bb0637e2d410e8e702d709ed9c079)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:17.327605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:17.373330 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98bb0637e2d410e8e702d709ed9c079'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.380312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98bb0637e2d410e8e702d709ed9c079'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.381705 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98bb0637e2d410e8e702d709ed9c079'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.382488 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98bb0637e2d410e8e702d709ed9c079'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.395756 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98bb0637e2d410e8e702d709ed9c079'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.408228 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1454/2881] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:34:17 2022] DELETE /identity/v3/users/c98bb0637e2d410e8e702d709ed9c079 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:17.412756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd6dd1-962c-4fa2-9282-d74131ab53d5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:17.413231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd6dd1-962c-4fa2-9282-d74131ab53d5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:17.413231 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd6dd1-962c-4fa2-9282-d74131ab53d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:17.433475 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-becd6dd1-962c-4fa2-9282-d74131ab53d5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:17.434672 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-becd6dd1-962c-4fa2-9282-d74131ab53d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:17.494807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1428/2882] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:17.504395 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:17.505850 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:17.563864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805aea5b-fc19-4976-8343-42df04971224 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:17.567472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c8193-a5ef-4cc8-b5b2-95c9ea16cdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:17.568070 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c8193-a5ef-4cc8-b5b2-95c9ea16cdec service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:17.568351 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c8193-a5ef-4cc8-b5b2-95c9ea16cdec service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:17.568628 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c8193-a5ef-4cc8-b5b2-95c9ea16cdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:17.577561 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c8193-a5ef-4cc8-b5b2-95c9ea16cdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:17.578978 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c8193-a5ef-4cc8-b5b2-95c9ea16cdec service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:17.589200 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1455/2883] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:17.856325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd6dd1-962c-4fa2-9282-d74131ab53d5 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:17.857858 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-becd6dd1-962c-4fa2-9282-d74131ab53d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:17.870296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd6dd1-962c-4fa2-9282-d74131ab53d5 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:17.875188 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:17.875831 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:17.876114 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:17.876400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] PATH_INFO: `/v3/projects/b65ea9d33eee45d4897ef1e7e563e7df` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:17.877565 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65ea9d33eee45d4897ef1e7e563e7df)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:17.879507 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:17.927263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65ea9d33eee45d4897ef1e7e563e7df', 'request_id': 'req-8befc83e-e42a-4842-a234-f375e9bb81c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.934050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65ea9d33eee45d4897ef1e7e563e7df', 'request_id': 'req-8befc83e-e42a-4842-a234-f375e9bb81c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.941388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65ea9d33eee45d4897ef1e7e563e7df', 'request_id': 'req-8befc83e-e42a-4842-a234-f375e9bb81c4'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.952111 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] The token cache is being invalidate because project b65ea9d33eee45d4897ef1e7e563e7df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:34:17.952400 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.953016 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:17.954485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1429/2884] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:34:17 2022] DELETE /identity/v3/projects/b65ea9d33eee45d4897ef1e7e563e7df => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:17.958417 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c8193-a5ef-4cc8-b5b2-95c9ea16cdec service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:17.968606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c8193-a5ef-4cc8-b5b2-95c9ea16cdec service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:17.987167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:18.027640 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:18.028271 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:18.028555 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:18.028833 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] PATH_INFO: `/v3/users/cd3b549d0d47492aa6466f26ec1bdcba` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:18.029947 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3b549d0d47492aa6466f26ec1bdcba)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:18.031915 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:18.076862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3b549d0d47492aa6466f26ec1bdcba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.083887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3b549d0d47492aa6466f26ec1bdcba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.085015 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3b549d0d47492aa6466f26ec1bdcba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.085611 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3b549d0d47492aa6466f26ec1bdcba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.097454 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3b549d0d47492aa6466f26ec1bdcba'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.109926 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1456/2885] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:34:17 2022] DELETE /identity/v3/users/cd3b549d0d47492aa6466f26ec1bdcba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:18.378683 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:18.380254 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:18.394251 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befc83e-e42a-4842-a234-f375e9bb81c4 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:18.408388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:18.456823 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:18.457429 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:18.457664 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:18.457939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] PATH_INFO: `/v3/projects/0fc75aa61d534900ac02c43b5022446d` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:18.459255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc75aa61d534900ac02c43b5022446d)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:18.461245 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:18.507281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc75aa61d534900ac02c43b5022446d', 'request_id': 'req-bf599033-4513-4e59-a127-92a08b2f5548'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.513210 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc75aa61d534900ac02c43b5022446d', 'request_id': 'req-bf599033-4513-4e59-a127-92a08b2f5548'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.520296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc75aa61d534900ac02c43b5022446d', 'request_id': 'req-bf599033-4513-4e59-a127-92a08b2f5548'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.530734 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] The token cache is being invalidate because project 0fc75aa61d534900ac02c43b5022446d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:34:18.531050 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.531675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.533151 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1430/2886] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:34:18 2022] DELETE /identity/v3/projects/0fc75aa61d534900ac02c43b5022446d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:18.537690 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:18.539241 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:18.551725 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80778015-5714-459a-b1a7-7fda435ed840 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:18.608403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:18.609025 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:18.609303 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:18.609574 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] PATH_INFO: `/v3/users/6f3921a4ec7f4e92b0d6cedf7f13a61a` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:18.610665 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3921a4ec7f4e92b0d6cedf7f13a61a)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:18.612605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:18.655635 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:18.658419 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3921a4ec7f4e92b0d6cedf7f13a61a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.667418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3921a4ec7f4e92b0d6cedf7f13a61a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.668072 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3921a4ec7f4e92b0d6cedf7f13a61a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.668686 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3921a4ec7f4e92b0d6cedf7f13a61a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.681475 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-e6c8fb07-bc4f-49fd-9310-1c5a7abdf1fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3921a4ec7f4e92b0d6cedf7f13a61a'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:18.693728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1457/2887] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:34:18 2022] DELETE /identity/v3/users/6f3921a4ec7f4e92b0d6cedf7f13a61a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:18.962505 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:18.963887 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:18.979169 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf599033-4513-4e59-a127-92a08b2f5548 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:19.035978 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:19.036613 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.036893 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.037192 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] PATH_INFO: `/v3/projects/1fb2958f555d4f629ca7c9a332931c2e` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.038298 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb2958f555d4f629ca7c9a332931c2e)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:19.040222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:19.086296 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb2958f555d4f629ca7c9a332931c2e', 'request_id': 'req-5111f5bc-c55d-4589-a97b-7783ee506620'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:19.087392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:19.094284 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb2958f555d4f629ca7c9a332931c2e', 'request_id': 'req-5111f5bc-c55d-4589-a97b-7783ee506620'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:19.103143 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb2958f555d4f629ca7c9a332931c2e', 'request_id': 'req-5111f5bc-c55d-4589-a97b-7783ee506620'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:19.113388 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] The token cache is being invalidate because project 1fb2958f555d4f629ca7c9a332931c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:34:19.113675 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:19.114308 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-5111f5bc-c55d-4589-a97b-7783ee506620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:34:19.116662 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1431/2888] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:34:18 2022] DELETE /identity/v3/projects/1fb2958f555d4f629ca7c9a332931c2e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:19.122562 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec6c6-d046-478b-9575-9eb2f679d75e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.122855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec6c6-d046-478b-9575-9eb2f679d75e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.123163 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ec6c6-d046-478b-9575-9eb2f679d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.143120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-d88ec6c6-d046-478b-9575-9eb2f679d75e None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:19.144312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d88ec6c6-d046-478b-9575-9eb2f679d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:19.202604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1458/2889] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:19.210908 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea303573-d79b-49f4-8e52-59321a42d599 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.211224 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea303573-d79b-49f4-8e52-59321a42d599 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.211503 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea303573-d79b-49f4-8e52-59321a42d599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.231944 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ea303573-d79b-49f4-8e52-59321a42d599 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:19.233093 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ea303573-d79b-49f4-8e52-59321a42d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:19.242209 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1432/2890] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:19.246364 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ec6c6-d046-478b-9575-9eb2f679d75e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:19.256486 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ec6c6-d046-478b-9575-9eb2f679d75e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:19.261029 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:19.261627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.261908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.262184 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.262827 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:34:19.263187 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:19.264781 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:19.276474 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1459/2891] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:34:19.280821 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea303573-d79b-49f4-8e52-59321a42d599 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:19.290660 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea303573-d79b-49f4-8e52-59321a42d599 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:19.295360 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4771f-b239-43cf-a31b-bd9913e0e241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:19.295957 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4771f-b239-43cf-a31b-bd9913e0e241 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.296241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4771f-b239-43cf-a31b-bd9913e0e241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.296518 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4771f-b239-43cf-a31b-bd9913e0e241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.297146 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4771f-b239-43cf-a31b-bd9913e0e241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:19.299053 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4771f-b239-43cf-a31b-bd9913e0e241 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:19.326061 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1433/2892] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:34:19 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:34:19.330114 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:19.340040 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbf431-9775-4265-853a-cf8c9aeb6de9 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:19.396154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e707f-cafd-4ff7-b11c-ac4863f07d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:19.397028 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e707f-cafd-4ff7-b11c-ac4863f07d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.397321 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e707f-cafd-4ff7-b11c-ac4863f07d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.397605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e707f-cafd-4ff7-b11c-ac4863f07d19 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.398249 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e707f-cafd-4ff7-b11c-ac4863f07d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:19.400244 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e707f-cafd-4ff7-b11c-ac4863f07d19 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:19.422023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1460/2893] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:34:19 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:34:19.426393 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4771f-b239-43cf-a31b-bd9913e0e241 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:19.437302 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4771f-b239-43cf-a31b-bd9913e0e241 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:19.441927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23032715-b157-4302-bfa9-49632b9a7358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:19.442524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23032715-b157-4302-bfa9-49632b9a7358 admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.442807 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23032715-b157-4302-bfa9-49632b9a7358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.443149 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23032715-b157-4302-bfa9-49632b9a7358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.443837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23032715-b157-4302-bfa9-49632b9a7358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:19.445418 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23032715-b157-4302-bfa9-49632b9a7358 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:19.455358 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1434/2894] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:19.460086 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e707f-cafd-4ff7-b11c-ac4863f07d19 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:19.470300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e707f-cafd-4ff7-b11c-ac4863f07d19 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:19.475543 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4907bb-f638-443d-9dbf-c34a5b43504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:19.476231 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4907bb-f638-443d-9dbf-c34a5b43504a admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.476506 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4907bb-f638-443d-9dbf-c34a5b43504a admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.476774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4907bb-f638-443d-9dbf-c34a5b43504a admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.477403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4907bb-f638-443d-9dbf-c34a5b43504a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:19.478971 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4907bb-f638-443d-9dbf-c34a5b43504a admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:19.489489 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1461/2895] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:34:19.493706 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23032715-b157-4302-bfa9-49632b9a7358 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:19.503873 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23032715-b157-4302-bfa9-49632b9a7358 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:19.508489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:19.509131 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.509413 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.509695 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] PATH_INFO: `/v3/projects/7e730c0b4dfe472aac531f01d3f71f4c/users/c6979949ad8d4881aa9d7814fe566dd0/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.524599 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e730c0b4dfe472aac531f01d3f71f4c, user_id=c6979949ad8d4881aa9d7814fe566dd0, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:19.527262 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:19.540658 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1435/2896] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:34:19 2022] PUT /identity/v3/projects/7e730c0b4dfe472aac531f01d3f71f4c/users/c6979949ad8d4881aa9d7814fe566dd0/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:34:19.545624 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d488f-287f-4f8f-8f3e-1c55fe2e24ca None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.546071 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d488f-287f-4f8f-8f3e-1c55fe2e24ca None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.546167 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d488f-287f-4f8f-8f3e-1c55fe2e24ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.566068 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-225d488f-287f-4f8f-8f3e-1c55fe2e24ca None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:19.567287 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-225d488f-287f-4f8f-8f3e-1c55fe2e24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:19.587179 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:19.627544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1462/2897] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:19.637272 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:19.638984 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:19.697515 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04243d-5996-423c-8863-7a2b9248e91e admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:19.701222 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:19.701829 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:19.702112 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:19.702390 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:19.711934 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:19.713361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:19.723059 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1436/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:20.343701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c55a7-017a-499d-aa15-106c5429e34b None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:20.343983 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c55a7-017a-499d-aa15-106c5429e34b None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:20.344256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c55a7-017a-499d-aa15-106c5429e34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:20.372656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-3c7c55a7-017a-499d-aa15-106c5429e34b None None] MFA Rules not processed for user `c6979949ad8d4881aa9d7814fe566dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:20.373897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3c7c55a7-017a-499d-aa15-106c5429e34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:20.446341 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1463/2899] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:20.457572 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:20.459579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:20.518136 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9aa77d-ab77-4554-9ac2-59a3e33da9fa service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:20.522329 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:20.522938 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:20.523237 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:20.523528 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:20.532110 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:20.533520 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:20.542796 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1437/2900] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:21.900864 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d150-0faf-4946-b893-5e73adf493f4 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:21.901374 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d150-0faf-4946-b893-5e73adf493f4 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:21.901472 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d150-0faf-4946-b893-5e73adf493f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:21.920054 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-0e00d150-0faf-4946-b893-5e73adf493f4 None None] MFA Rules not processed for user `c6979949ad8d4881aa9d7814fe566dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:21.921240 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0e00d150-0faf-4946-b893-5e73adf493f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:21.928143 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1464/2901] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:21.972366 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:21.973729 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:21.996772 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:22.057685 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d37eea-3e83-4677-993e-056f42993d7d service cinder] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:22.061369 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a909fc6177e94d2fa6d38dad285e616a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:22.061980 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:22.062267 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:22.062581 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:22.064385 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:22.135091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:22.136468 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:22.148147 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1438/2902] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:34:22.356371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d150-0faf-4946-b893-5e73adf493f4 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:22.357750 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0e00d150-0faf-4946-b893-5e73adf493f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:22.370183 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d150-0faf-4946-b893-5e73adf493f4 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:22.373755 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:22.374348 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:22.374627 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:22.374903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:22.376616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:22.385902 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:22.387284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:22.395282 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1465/2903] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:22.717479 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:22.719178 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:22.729011 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:22.738121 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932f00e-4b2c-4ab5-b8cf-558d06017e5b service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:22.742540 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:22.743173 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:22.743452 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:22.743722 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:22.745413 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:22.759685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:22.761102 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:22.772098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1466/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:34:22.791081 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec215ce-53b2-47dc-8992-2a6f42a83bf8 service glance] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:22.796037 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c0df8-aa3c-47fb-a7a9-4f8974e8a26b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:22.796650 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0df8-aa3c-47fb-a7a9-4f8974e8a26b service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:22.796939 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0df8-aa3c-47fb-a7a9-4f8974e8a26b service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:22.797216 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c0df8-aa3c-47fb-a7a9-4f8974e8a26b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:22.798946 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-124c0df8-aa3c-47fb-a7a9-4f8974e8a26b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:22.811712 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c0df8-aa3c-47fb-a7a9-4f8974e8a26b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:22.813434 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c0df8-aa3c-47fb-a7a9-4f8974e8a26b service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:22.824757 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1439/2905] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:34:24.585677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:24.594361 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d4aa2-0865-4d84-848a-f0139ef7d2d3 service neutron] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:24.598318 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f04e04-397b-482e-95ac-00b47ab7baec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:24.598908 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f04e04-397b-482e-95ac-00b47ab7baec service neutron] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:24.599218 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f04e04-397b-482e-95ac-00b47ab7baec service neutron] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:24.599491 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f04e04-397b-482e-95ac-00b47ab7baec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:24.602181 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-74f04e04-397b-482e-95ac-00b47ab7baec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:24.611663 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f04e04-397b-482e-95ac-00b47ab7baec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:24.613059 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f04e04-397b-482e-95ac-00b47ab7baec service neutron] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:24.621645 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1467/2906] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:34:32.819202 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=86 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:34.618087 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=68 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:38.538212 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de5bf-32ae-4238-9741-29889f1d8f9d None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:38.538720 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de5bf-32ae-4238-9741-29889f1d8f9d None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:38.539129 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120de5bf-32ae-4238-9741-29889f1d8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:38.559879 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-120de5bf-32ae-4238-9741-29889f1d8f9d None None] MFA Rules not processed for user `c6979949ad8d4881aa9d7814fe566dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:38.561397 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-120de5bf-32ae-4238-9741-29889f1d8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:38.568077 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1440/2907] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:34:48.552716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:34:56.807092 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d89558-8a22-4a52-ae07-4959de8867fb None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:56.807604 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d89558-8a22-4a52-ae07-4959de8867fb None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:56.807719 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d89558-8a22-4a52-ae07-4959de8867fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:56.856591 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e5d89558-8a22-4a52-ae07-4959de8867fb None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:34:56.857829 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e5d89558-8a22-4a52-ae07-4959de8867fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:56.923432 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1468/2908] 10.222.0.20 () {58 vars in 1009 bytes} [Fri Sep 16 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:34:56.972989 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120de5bf-32ae-4238-9741-29889f1d8f9d None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:34:56.974389 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-120de5bf-32ae-4238-9741-29889f1d8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:34:57.065096 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120de5bf-32ae-4238-9741-29889f1d8f9d None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:34:57.070587 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78760e99-b605-4e86-82b8-215a8e83659d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:34:57.071241 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78760e99-b605-4e86-82b8-215a8e83659d service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:34:57.071611 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78760e99-b605-4e86-82b8-215a8e83659d service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:34:57.071883 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78760e99-b605-4e86-82b8-215a8e83659d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:34:57.079826 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78760e99-b605-4e86-82b8-215a8e83659d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:34:57.081376 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78760e99-b605-4e86-82b8-215a8e83659d service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:34:57.089419 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1441/2909] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:34:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 19:35:06.920706 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=40 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:07.086531 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=41 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:11.388255 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c55e0-f1e9-4ccf-b5fc-4bc42edf7e1e None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:11.388723 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c55e0-f1e9-4ccf-b5fc-4bc42edf7e1e None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:11.388828 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c55e0-f1e9-4ccf-b5fc-4bc42edf7e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:11.408605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8a4c55e0-f1e9-4ccf-b5fc-4bc42edf7e1e None None] MFA Rules not processed for user `09a4d22349684197b39b673845815054`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:11.409799 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8a4c55e0-f1e9-4ccf-b5fc-4bc42edf7e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:11.417438 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1469/2910] 10.222.0.20 () {58 vars in 967 bytes} [Fri Sep 16 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:11.429450 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78760e99-b605-4e86-82b8-215a8e83659d service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:11.440392 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78760e99-b605-4e86-82b8-215a8e83659d service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:11.445193 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5994a9-c1fe-4535-a232-a05b2383af71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '778fb2fe04a242a0a7e4b5b062fc0775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:11.445786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5994a9-c1fe-4535-a232-a05b2383af71 service swift] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:11.446068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5994a9-c1fe-4535-a232-a05b2383af71 service swift] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:11.446363 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5994a9-c1fe-4535-a232-a05b2383af71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:11.454461 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5994a9-c1fe-4535-a232-a05b2383af71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:11.456068 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5994a9-c1fe-4535-a232-a05b2383af71 service swift] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:11.464512 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1442/2911] 10.222.0.20 () {60 vars in 1384 bytes} [Fri Sep 16 19:35:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 19:35:13.371872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c55e0-f1e9-4ccf-b5fc-4bc42edf7e1e None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:13.385373 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c55e0-f1e9-4ccf-b5fc-4bc42edf7e1e None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:13.389977 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:13.390608 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:13.390885 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:13.391192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] PATH_INFO: `/v3/users/c6979949ad8d4881aa9d7814fe566dd0` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:13.392313 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6979949ad8d4881aa9d7814fe566dd0)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:13.394291 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:13.446162 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6979949ad8d4881aa9d7814fe566dd0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.454323 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6979949ad8d4881aa9d7814fe566dd0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.454936 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6979949ad8d4881aa9d7814fe566dd0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.455587 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6979949ad8d4881aa9d7814fe566dd0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.467786 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-319cdc8e-1479-4cd8-8800-23485551a192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6979949ad8d4881aa9d7814fe566dd0'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.482023 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1470/2912] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:35:13 2022] DELETE /identity/v3/users/c6979949ad8d4881aa9d7814fe566dd0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:13.656125 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5994a9-c1fe-4535-a232-a05b2383af71 service swift] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:13.668516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5994a9-c1fe-4535-a232-a05b2383af71 service swift] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:13.726311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:13.726935 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:13.727243 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:13.727516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] PATH_INFO: `/v3/projects/7e730c0b4dfe472aac531f01d3f71f4c` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:13.729311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e730c0b4dfe472aac531f01d3f71f4c)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:13.731598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:13.777575 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e730c0b4dfe472aac531f01d3f71f4c', 'request_id': 'req-e057b43a-6dd6-4689-9798-3e56b762dc37'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.783924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e730c0b4dfe472aac531f01d3f71f4c', 'request_id': 'req-e057b43a-6dd6-4689-9798-3e56b762dc37'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.791546 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e730c0b4dfe472aac531f01d3f71f4c', 'request_id': 'req-e057b43a-6dd6-4689-9798-3e56b762dc37'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.805985 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] The token cache is being invalidate because project 7e730c0b4dfe472aac531f01d3f71f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:35:13.806380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.807201 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-e057b43a-6dd6-4689-9798-3e56b762dc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:35:13.808741 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1443/2913] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:35:13 2022] DELETE /identity/v3/projects/7e730c0b4dfe472aac531f01d3f71f4c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:13.813857 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280ddfb-51d4-452e-b1b7-af619e09bc98 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:13.814147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280ddfb-51d4-452e-b1b7-af619e09bc98 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:13.814426 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280ddfb-51d4-452e-b1b7-af619e09bc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:13.834194 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8280ddfb-51d4-452e-b1b7-af619e09bc98 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:13.835437 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8280ddfb-51d4-452e-b1b7-af619e09bc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:13.897376 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1471/2914] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:13.905789 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6fe02-e9ff-4861-b3f0-e49f0c36c8fd None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:13.906041 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6fe02-e9ff-4861-b3f0-e49f0c36c8fd None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:13.906315 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6fe02-e9ff-4861-b3f0-e49f0c36c8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:13.926039 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-32c6fe02-e9ff-4861-b3f0-e49f0c36c8fd None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:13.927263 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-32c6fe02-e9ff-4861-b3f0-e49f0c36c8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:13.935325 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1444/2915] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:13.939527 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280ddfb-51d4-452e-b1b7-af619e09bc98 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:13.949872 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280ddfb-51d4-452e-b1b7-af619e09bc98 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:13.954366 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:13.954961 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:13.955284 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:13.955560 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:13.956237 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81368) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 19:35:13.956542 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:13.958124 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:13.970192 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1472/2916] 10.222.0.20 () {58 vars in 1153 bytes} [Fri Sep 16 19:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 19:35:13.974618 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6fe02-e9ff-4861-b3f0-e49f0c36c8fd None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:13.983976 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6fe02-e9ff-4861-b3f0-e49f0c36c8fd None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:13.988764 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d88abb-f7e1-48f9-9e66-27424416fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:13.989365 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88abb-f7e1-48f9-9e66-27424416fa50 admin admin] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:13.989646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88abb-f7e1-48f9-9e66-27424416fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:13.989924 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d88abb-f7e1-48f9-9e66-27424416fa50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:13.990556 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d88abb-f7e1-48f9-9e66-27424416fa50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:13.992485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d88abb-f7e1-48f9-9e66-27424416fa50 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:14.019682 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1445/2917] 10.222.0.20 () {60 vars in 1153 bytes} [Fri Sep 16 19:35:13 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 19:35:14.023844 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:14.034520 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e849ce0-f8ad-4601-9093-9b8dd05bd8d3 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:14.080619 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:14.091065 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a784e17-541a-4f1c-988b-3c58ed155419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:14.091841 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784e17-541a-4f1c-988b-3c58ed155419 admin admin] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:14.092325 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784e17-541a-4f1c-988b-3c58ed155419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:14.092658 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784e17-541a-4f1c-988b-3c58ed155419 admin admin] PATH_INFO: `/v3/users` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:14.093508 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a784e17-541a-4f1c-988b-3c58ed155419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:14.095680 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a784e17-541a-4f1c-988b-3c58ed155419 admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:14.116897 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1473/2918] 10.222.0.20 () {60 vars in 1144 bytes} [Fri Sep 16 19:35:14 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 19:35:14.121554 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d88abb-f7e1-48f9-9e66-27424416fa50 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:14.131769 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d88abb-f7e1-48f9-9e66-27424416fa50 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:14.136999 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5fbed-f0aa-4554-9277-f73a1ebf06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:14.137584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5fbed-f0aa-4554-9277-f73a1ebf06ff admin admin] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:14.137981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5fbed-f0aa-4554-9277-f73a1ebf06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:14.138257 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5fbed-f0aa-4554-9277-f73a1ebf06ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:14.139023 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5fbed-f0aa-4554-9277-f73a1ebf06ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:14.140593 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5fbed-f0aa-4554-9277-f73a1ebf06ff admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:14.150516 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1446/2919] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:35:14.154371 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a784e17-541a-4f1c-988b-3c58ed155419 admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:14.164288 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a784e17-541a-4f1c-988b-3c58ed155419 admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:14.169067 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cd505-b908-4beb-9119-6d6e2b6284da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:14.169656 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cd505-b908-4beb-9119-6d6e2b6284da admin admin] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:14.169933 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cd505-b908-4beb-9119-6d6e2b6284da admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:14.170206 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cd505-b908-4beb-9119-6d6e2b6284da admin admin] PATH_INFO: `/v3/roles` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:14.170835 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cd505-b908-4beb-9119-6d6e2b6284da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:14.172433 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cd505-b908-4beb-9119-6d6e2b6284da admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:14.183740 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1474/2920] 10.222.0.20 () {58 vars in 1122 bytes} [Fri Sep 16 19:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 19:35:14.187721 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5fbed-f0aa-4554-9277-f73a1ebf06ff admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:14.197731 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5fbed-f0aa-4554-9277-f73a1ebf06ff admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:14.202499 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:14.203206 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:14.203489 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:14.203766 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] PATH_INFO: `/v3/projects/84175b5ae0b74b56b195f4d6e5dbae04/users/812e7979a1924459a95f1620db07368c/roles/f686c7083ea64f748bfab4a77dd732e2` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:14.218853 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84175b5ae0b74b56b195f4d6e5dbae04, user_id=812e7979a1924459a95f1620db07368c, role_id=f686c7083ea64f748bfab4a77dd732e2)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:14.221963 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:14.234616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1447/2921] 10.222.0.20 () {60 vars in 1483 bytes} [Fri Sep 16 19:35:14 2022] PUT /identity/v3/projects/84175b5ae0b74b56b195f4d6e5dbae04/users/812e7979a1924459a95f1620db07368c/roles/f686c7083ea64f748bfab4a77dd732e2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:35:14.239748 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f436-2b7b-4bbf-b2c5-bd8e4a3a4cee None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:14.240033 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f436-2b7b-4bbf-b2c5-bd8e4a3a4cee None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:14.240306 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f436-2b7b-4bbf-b2c5-bd8e4a3a4cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:14.259212 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-f2c3f436-2b7b-4bbf-b2c5-bd8e4a3a4cee None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:14.260514 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f2c3f436-2b7b-4bbf-b2c5-bd8e4a3a4cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:14.320576 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1475/2922] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:14.330911 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:14.332624 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:14.347704 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:14.391696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd566bb2-3392-40b5-a721-7dc7f3e98558 admin admin] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:14.395536 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:14.396139 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:14.396417 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:14.396691 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:14.406438 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:14.407886 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:14.418219 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1448/2923] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:15.048154 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92569dd-d019-4e8f-a1e5-7db637d33722 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:15.048677 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92569dd-d019-4e8f-a1e5-7db637d33722 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:15.048780 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92569dd-d019-4e8f-a1e5-7db637d33722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:15.079123 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-e92569dd-d019-4e8f-a1e5-7db637d33722 None None] MFA Rules not processed for user `812e7979a1924459a95f1620db07368c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:15.080534 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-e92569dd-d019-4e8f-a1e5-7db637d33722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:15.152824 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1476/2924] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:15.163361 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:15.164739 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:15.227394 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8f9cf-0b27-4a78-80b0-94cd9d06f879 service neutron] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:15.232368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae94a5-f02b-4dfe-b99a-12556870fde6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ef7ff56b97e4ca3af05cc407419d906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:15.232993 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae94a5-f02b-4dfe-b99a-12556870fde6 service cinder] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:15.233255 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae94a5-f02b-4dfe-b99a-12556870fde6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:15.233524 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae94a5-f02b-4dfe-b99a-12556870fde6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:15.242057 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae94a5-f02b-4dfe-b99a-12556870fde6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:15.243457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae94a5-f02b-4dfe-b99a-12556870fde6 service cinder] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:15.252470 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1449/2925] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:16.613702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b68c9-5979-488c-9402-9635e28f111f None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:16.614195 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b68c9-5979-488c-9402-9635e28f111f None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:16.614312 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b68c9-5979-488c-9402-9635e28f111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:16.633495 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-016b68c9-5979-488c-9402-9635e28f111f None None] MFA Rules not processed for user `812e7979a1924459a95f1620db07368c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:16.634692 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-016b68c9-5979-488c-9402-9635e28f111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:16.642403 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1477/2926] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:35:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 19:35:25.248485 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=46 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:26.628131 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:35:45.817000 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f4418-14e0-4a39-b326-6fc752c02479 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:45.817548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f4418-14e0-4a39-b326-6fc752c02479 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:45.817548 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f4418-14e0-4a39-b326-6fc752c02479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:45.836931 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-1c1f4418-14e0-4a39-b326-6fc752c02479 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:45.838122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-1c1f4418-14e0-4a39-b326-6fc752c02479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:45.846452 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1450/2927] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:45.872128 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b68c9-5979-488c-9402-9635e28f111f None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:45.873545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-016b68c9-5979-488c-9402-9635e28f111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:45.946356 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b68c9-5979-488c-9402-9635e28f111f None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:45.951842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:45.952445 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:45.952728 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:45.953003 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:45.961127 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:45.962685 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:45.972314 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1478/2928] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:48.883977 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c7de-6e7e-499c-93cb-39968f8143c5 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:48.884543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c7de-6e7e-499c-93cb-39968f8143c5 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:48.884543 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481c7de-6e7e-499c-93cb-39968f8143c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:48.903656 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c481c7de-6e7e-499c-93cb-39968f8143c5 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:48.904866 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c481c7de-6e7e-499c-93cb-39968f8143c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:48.912787 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1451/2929] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:48.932854 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:48.934254 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:48.949612 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d69eb-1ef3-478d-9b3b-aa43d805022a service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:48.955110 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe255ae6-61ac-4f27-bf2f-61feffabfcf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:48.955699 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe255ae6-61ac-4f27-bf2f-61feffabfcf4 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:48.955979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe255ae6-61ac-4f27-bf2f-61feffabfcf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:48.956252 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe255ae6-61ac-4f27-bf2f-61feffabfcf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:48.964914 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe255ae6-61ac-4f27-bf2f-61feffabfcf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:48.966480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe255ae6-61ac-4f27-bf2f-61feffabfcf4 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:48.976546 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1479/2930] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:52.153166 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ee3af-c73f-4f5a-a420-2146b31f74a0 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:52.153696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ee3af-c73f-4f5a-a420-2146b31f74a0 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:52.153696 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ee3af-c73f-4f5a-a420-2146b31f74a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:52.174344 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-b21ee3af-c73f-4f5a-a420-2146b31f74a0 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:52.175579 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-b21ee3af-c73f-4f5a-a420-2146b31f74a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:52.183448 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1452/2931] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:52.204120 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe255ae6-61ac-4f27-bf2f-61feffabfcf4 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:52.215256 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe255ae6-61ac-4f27-bf2f-61feffabfcf4 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:52.222038 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d401-d49a-4317-bcdc-8cfb6a9e1889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:52.222679 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d401-d49a-4317-bcdc-8cfb6a9e1889 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:52.223013 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d401-d49a-4317-bcdc-8cfb6a9e1889 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:52.223280 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d401-d49a-4317-bcdc-8cfb6a9e1889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:52.231813 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913d401-d49a-4317-bcdc-8cfb6a9e1889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:52.233377 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913d401-d49a-4317-bcdc-8cfb6a9e1889 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:52.244766 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1480/2932] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:35:55.238545 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276645b-f71e-444d-a043-702095c5d1bb None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:55.239133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276645b-f71e-444d-a043-702095c5d1bb None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:55.239133 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c276645b-f71e-444d-a043-702095c5d1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:55.259488 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-c276645b-f71e-444d-a043-702095c5d1bb None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:55.260715 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-c276645b-f71e-444d-a043-702095c5d1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:55.268756 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1453/2933] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:55.290689 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d401-d49a-4317-bcdc-8cfb6a9e1889 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:55.302148 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d401-d49a-4317-bcdc-8cfb6a9e1889 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:55.307588 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91429e-3dc7-41ea-843e-eb5b40b6691b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:55.308177 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91429e-3dc7-41ea-843e-eb5b40b6691b service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:55.308461 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91429e-3dc7-41ea-843e-eb5b40b6691b service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:55.308735 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91429e-3dc7-41ea-843e-eb5b40b6691b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:55.317307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91429e-3dc7-41ea-843e-eb5b40b6691b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:55.318862 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91429e-3dc7-41ea-843e-eb5b40b6691b service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:55.328327 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1481/2934] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:35:59.426852 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23069f-aaaf-455d-a604-4b98a1179352 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:59.427797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23069f-aaaf-455d-a604-4b98a1179352 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:59.427797 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23069f-aaaf-455d-a604-4b98a1179352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:59.449862 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-ef23069f-aaaf-455d-a604-4b98a1179352 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:35:59.451116 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-ef23069f-aaaf-455d-a604-4b98a1179352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:35:59.459949 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1454/2935] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:35:59.483743 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91429e-3dc7-41ea-843e-eb5b40b6691b service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:35:59.497550 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91429e-3dc7-41ea-843e-eb5b40b6691b service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:35:59.505116 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353eac8-7eed-43d2-a3e0-84e3be36ddeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:35:59.505720 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353eac8-7eed-43d2-a3e0-84e3be36ddeb service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:35:59.505996 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353eac8-7eed-43d2-a3e0-84e3be36ddeb service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:35:59.506267 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353eac8-7eed-43d2-a3e0-84e3be36ddeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:35:59.515513 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353eac8-7eed-43d2-a3e0-84e3be36ddeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:35:59.517398 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353eac8-7eed-43d2-a3e0-84e3be36ddeb service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:35:59.528714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1482/2936] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:02.590200 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12db0-4b11-4568-afdf-5761bb160c4a None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:02.590726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12db0-4b11-4568-afdf-5761bb160c4a None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:02.590726 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12db0-4b11-4568-afdf-5761bb160c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:02.609897 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-9ce12db0-4b11-4568-afdf-5761bb160c4a None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:02.611633 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-9ce12db0-4b11-4568-afdf-5761bb160c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:02.619459 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1455/2937] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:02.641827 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353eac8-7eed-43d2-a3e0-84e3be36ddeb service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:02.653185 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353eac8-7eed-43d2-a3e0-84e3be36ddeb service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:02.659261 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e92ef1-233c-4fe9-a907-468949e94da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:02.659856 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92ef1-233c-4fe9-a907-468949e94da5 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:02.660140 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92ef1-233c-4fe9-a907-468949e94da5 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:02.660418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e92ef1-233c-4fe9-a907-468949e94da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:02.668648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e92ef1-233c-4fe9-a907-468949e94da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:02.670220 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e92ef1-233c-4fe9-a907-468949e94da5 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:02.680538 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1483/2938] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:12.535860 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12db0-4b11-4568-afdf-5761bb160c4a None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:12.549945 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12db0-4b11-4568-afdf-5761bb160c4a None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:12.556180 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:12.556783 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:12.557062 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:12.557335 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:12.559100 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:12.573617 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:12.575229 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:12.586563 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1456/2939] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:12.676226 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=64 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:17.706104 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a113c-6103-4882-aa7f-0faaee3d13c0 None None] REQUEST_METHOD: `POST` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:17.706681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a113c-6103-4882-aa7f-0faaee3d13c0 None None] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:17.706681 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a113c-6103-4882-aa7f-0faaee3d13c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:17.725731 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.auth.core [None req-8a7a113c-6103-4882-aa7f-0faaee3d13c0 None None] MFA Rules not processed for user `812e7979a1924459a95f1620db07368c`. Rule list: `[]` (Enabled: `True`). {{(pid=81368) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:17.726931 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-8a7a113c-6103-4882-aa7f-0faaee3d13c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:17.733702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1484/2940] 10.222.0.20 () {58 vars in 958 bytes} [Fri Sep 16 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:17.963463 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:17.964922 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:17.972249 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=25 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:17.978634 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa8036-2471-4de6-a4c8-267ee1b42f08 service nova] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:17.982282 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25668669-bc8b-45dc-a754-5186cdbb5651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0ab0eca7de4bed89b5f292a52f8c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:17.982870 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25668669-bc8b-45dc-a754-5186cdbb5651 service neutron] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:17.983183 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25668669-bc8b-45dc-a754-5186cdbb5651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:17.983457 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25668669-bc8b-45dc-a754-5186cdbb5651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:17.985736 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-25668669-bc8b-45dc-a754-5186cdbb5651 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:17.995091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25668669-bc8b-45dc-a754-5186cdbb5651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:17.996498 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25668669-bc8b-45dc-a754-5186cdbb5651 service neutron] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:18.004604 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1457/2941] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:26.618302 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a113c-6103-4882-aa7f-0faaee3d13c0 None None] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:26.671091 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a113c-6103-4882-aa7f-0faaee3d13c0 None None] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:26.677605 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:26.678216 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:26.678558 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:26.679494 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:26.681482 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:26.713300 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:26.714866 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:26.726409 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1485/2942] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:28.000912 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=5 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:31.611091 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2cae0-25c5-485a-9017-b59793e2ee60 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:31.611718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2cae0-25c5-485a-9017-b59793e2ee60 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:31.611718 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2cae0-25c5-485a-9017-b59793e2ee60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:31.630903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-a6d2cae0-25c5-485a-9017-b59793e2ee60 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:31.632140 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-a6d2cae0-25c5-485a-9017-b59793e2ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:31.639923 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1458/2943] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:31.659648 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:31.670887 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc0ecd-f4ed-4590-a122-b5a5960c59e9 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:31.676702 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e599f-d4f1-46ab-82bc-7fd745974a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:31.677412 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e599f-d4f1-46ab-82bc-7fd745974a12 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:31.677701 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e599f-d4f1-46ab-82bc-7fd745974a12 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:31.677979 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e599f-d4f1-46ab-82bc-7fd745974a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:31.686239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e599f-d4f1-46ab-82bc-7fd745974a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:31.687865 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e599f-d4f1-46ab-82bc-7fd745974a12 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:31.697334 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1486/2944] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:34.871661 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b426bd8-5533-41f9-b612-a7e12c2f8798 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:34.872208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b426bd8-5533-41f9-b612-a7e12c2f8798 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:34.872208 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b426bd8-5533-41f9-b612-a7e12c2f8798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:34.892311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-2b426bd8-5533-41f9-b612-a7e12c2f8798 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:34.893514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-2b426bd8-5533-41f9-b612-a7e12c2f8798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:34.901281 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1459/2945] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:34.924465 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e599f-d4f1-46ab-82bc-7fd745974a12 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:34.935779 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e599f-d4f1-46ab-82bc-7fd745974a12 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:34.941266 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915989f-1201-462f-ae60-2ca3799e56d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:34.941859 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915989f-1201-462f-ae60-2ca3799e56d6 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:34.942141 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915989f-1201-462f-ae60-2ca3799e56d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:34.942418 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915989f-1201-462f-ae60-2ca3799e56d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:34.950606 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915989f-1201-462f-ae60-2ca3799e56d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:34.952211 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915989f-1201-462f-ae60-2ca3799e56d6 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:34.961584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1487/2946] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 19:36:37.970102 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6d321-2f05-4fb0-b4cc-e80ffcda2967 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:37.970598 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6d321-2f05-4fb0-b4cc-e80ffcda2967 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:37.970716 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6d321-2f05-4fb0-b4cc-e80ffcda2967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:37.990368 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-5de6d321-2f05-4fb0-b4cc-e80ffcda2967 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:37.991863 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-5de6d321-2f05-4fb0-b4cc-e80ffcda2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:38.003067 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1460/2947] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:38.024609 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915989f-1201-462f-ae60-2ca3799e56d6 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:38.036332 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915989f-1201-462f-ae60-2ca3799e56d6 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:38.041691 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497da6ca-976e-455d-a921-d8cb13a73a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:38.042307 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497da6ca-976e-455d-a921-d8cb13a73a81 service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:38.042584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497da6ca-976e-455d-a921-d8cb13a73a81 service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:38.042855 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497da6ca-976e-455d-a921-d8cb13a73a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:38.050934 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497da6ca-976e-455d-a921-d8cb13a73a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:38.052510 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497da6ca-976e-455d-a921-d8cb13a73a81 service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:38.061671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1488/2948] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:41.114514 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6e75-224b-4dec-9e30-78f0e6ecf9d1 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:41.115042 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6e75-224b-4dec-9e30-78f0e6ecf9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:41.115163 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6e75-224b-4dec-9e30-78f0e6ecf9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:41.134646 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-f9ba6e75-224b-4dec-9e30-78f0e6ecf9d1 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:41.135869 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-f9ba6e75-224b-4dec-9e30-78f0e6ecf9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:41.143837 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1461/2949] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:41.166202 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497da6ca-976e-455d-a921-d8cb13a73a81 service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:41.178579 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497da6ca-976e-455d-a921-d8cb13a73a81 service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:41.183913 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932b4a9-803f-4398-9f9e-8f8a870c380d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:41.184498 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b4a9-803f-4398-9f9e-8f8a870c380d service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:41.184774 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b4a9-803f-4398-9f9e-8f8a870c380d service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:41.185046 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932b4a9-803f-4398-9f9e-8f8a870c380d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:41.193446 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932b4a9-803f-4398-9f9e-8f8a870c380d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:41.195019 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932b4a9-803f-4398-9f9e-8f8a870c380d service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:41.204443 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1489/2950] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:45.316311 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7daf4d-094a-47ab-b222-e953f2240f00 None None] REQUEST_METHOD: `POST` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:45.316840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7daf4d-094a-47ab-b222-e953f2240f00 None None] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:45.316840 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7daf4d-094a-47ab-b222-e953f2240f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:45.336584 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.auth.core [None req-6b7daf4d-094a-47ab-b222-e953f2240f00 None None] MFA Rules not processed for user `332f1f7a6eb8406bb2e4f9921b706cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81367) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 19:36:45.337786 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6b7daf4d-094a-47ab-b222-e953f2240f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:45.345616 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1462/2951] 10.222.0.25 () {58 vars in 1016 bytes} [Fri Sep 16 19:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 19:36:45.373876 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932b4a9-803f-4398-9f9e-8f8a870c380d service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:45.380684 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=59 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:45.386868 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932b4a9-803f-4398-9f9e-8f8a870c380d service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:45.392239 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a3678-e896-45e3-be2e-fa49f7b7e4ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c915a2b20a2c48a682ef08528e482b96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:45.392830 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a3678-e896-45e3-be2e-fa49f7b7e4ba service nova] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:45.393671 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a3678-e896-45e3-be2e-fa49f7b7e4ba service nova] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:45.393994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a3678-e896-45e3-be2e-fa49f7b7e4ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:45.402112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a3678-e896-45e3-be2e-fa49f7b7e4ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:45.403715 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a3678-e896-45e3-be2e-fa49f7b7e4ba service nova] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:45.413007 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1490/2952] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:46.992354 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7daf4d-094a-47ab-b222-e953f2240f00 None None] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:36:46.993799 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-6b7daf4d-094a-47ab-b222-e953f2240f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:47.082130 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7daf4d-094a-47ab-b222-e953f2240f00 None None] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:36:47.087122 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:36:47.087738 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] REQUEST_METHOD: `GET` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:36:47.088047 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:36:47.088297 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:36:47.090022 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.fernet_utils [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81367) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:36:47.102313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:36:47.103903 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:36:47.114313 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1463/2953] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:36:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:36:55.408736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=5 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:36:57.109410 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=56 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:17.440410 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a3678-e896-45e3-be2e-fa49f7b7e4ba service nova] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:17.468584 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a3678-e896-45e3-be2e-fa49f7b7e4ba service nova] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:17.473630 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:17.474264 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:17.474544 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:17.474818 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] PATH_INFO: `/v3/users/812e7979a1924459a95f1620db07368c` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:17.476000 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] RBAC: Authorizing `identity:delete_user(user_id=812e7979a1924459a95f1620db07368c)` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:17.478753 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:17.524450 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812e7979a1924459a95f1620db07368c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.531479 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812e7979a1924459a95f1620db07368c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.532098 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812e7979a1924459a95f1620db07368c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.532714 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812e7979a1924459a95f1620db07368c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.545147 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.notifications [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812e7979a1924459a95f1620db07368c'} {{(pid=81368) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.557616 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1491/2954] 10.222.0.20 () {58 vars in 1224 bytes} [Fri Sep 16 19:37:17 2022] DELETE /identity/v3/users/812e7979a1924459a95f1620db07368c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:17.729355 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] Authenticating user token {{(pid=81367) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:37:17.739927 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974d9c-36e6-4381-9058-65901f69af51 service placement] Validating token access rules against request {{(pid=81367) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:37:17.798748 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '332f1f7a6eb8406bb2e4f9921b706cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15e72dcb5f5c45fcb95f7b09027953b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81367) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:37:17.799414 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:37:17.799700 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:37:17.799981 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] PATH_INFO: `/v3/projects/84175b5ae0b74b56b195f4d6e5dbae04` {{(pid=81367) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:37:17.801098 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84175b5ae0b74b56b195f4d6e5dbae04)` {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:37:17.803010 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] RBAC: Authorization granted {{(pid=81367) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:37:17.849481 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84175b5ae0b74b56b195f4d6e5dbae04', 'request_id': 'req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.856508 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84175b5ae0b74b56b195f4d6e5dbae04', 'request_id': 'req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.863674 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84175b5ae0b74b56b195f4d6e5dbae04', 'request_id': 'req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34'} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.886109 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] The token cache is being invalidate because project 84175b5ae0b74b56b195f4d6e5dbae04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81367) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 19:37:17.886380 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.887018 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG keystone.notifications [None req-a9b116be-fd42-4aa9-a4d1-5197adcb9f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81367) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 19:37:17.888487 dv-cinder-803773-5-smb devstack@keystone.service[81367]: [pid: 81367|app: 0|req: 1464/2955] 10.222.0.20 () {58 vars in 1233 bytes} [Fri Sep 16 19:37:17 2022] DELETE /identity/v3/projects/84175b5ae0b74b56b195f4d6e5dbae04 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 19:37:27.553545 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:37:27.884289 dv-cinder-803773-5-smb devstack@keystone.service[81367]: DEBUG dbcounter [-] [81367] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81367) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 19:41:51.993842 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] Authenticating user token {{(pid=81368) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 19:41:51.995286 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:41:52.063994 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace05e-0d39-403a-99e6-c1b1c35e303b admin admin] Validating token access rules against request {{(pid=81368) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 19:41:52.123224 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a8eaf-9d3b-4cc5-90ec-a84ab85f5412 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af8934abda44859938a55bf4daf83d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58fc82bb1e764e4ca9766eda4a9d8ba4', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81368) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 19:41:52.123831 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8eaf-9d3b-4cc5-90ec-a84ab85f5412 service placement] REQUEST_METHOD: `GET` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 19:41:52.124112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8eaf-9d3b-4cc5-90ec-a84ab85f5412 service placement] SCRIPT_NAME: `/identity` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 19:41:52.124387 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a8eaf-9d3b-4cc5-90ec-a84ab85f5412 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81368) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 19:41:52.126094 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.fernet_utils [None req-d65a8eaf-9d3b-4cc5-90ec-a84ab85f5412 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81368) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 19:41:52.137480 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a8eaf-9d3b-4cc5-90ec-a84ab85f5412 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 19:41:52.139112 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a8eaf-9d3b-4cc5-90ec-a84ab85f5412 service placement] RBAC: Authorization granted {{(pid=81368) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 19:41:52.148903 dv-cinder-803773-5-smb devstack@keystone.service[81368]: [pid: 81368|app: 0|req: 1492/2956] 10.222.0.20 () {60 vars in 1365 bytes} [Fri Sep 16 19:41:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 19:42:02.144736 dv-cinder-803773-5-smb devstack@keystone.service[81368]: DEBUG dbcounter [-] [81368] Writing DB stats keystone:SELECT=58 {{(pid=81368) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}